00000001:02000400:3.0F:1788526409.097225:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788526418.637880:0:3155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788526419.712898:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1311 MB/s 00000001:01000000:2.0:1788526419.962848:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1607 MB/s 00000001:01000000:2.0:1788526420.212449:0:3215:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10371 MB/s 00000020:02000000:0.0F:1788526420.973961:0:3246:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g0efcf2a 00000400:02000000:1.0F:1788526422.188881:0:3261:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.159@tcp [8/256/0/180] 00008000:02000000:1.0:1788526426.623668:0:3411:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788526482.363506:0:5220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788526494.800842:0:5804:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788526494.800862:0:5804:0:(obd_mount.c:928:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788526494.801006:0:5804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000317509bf 00000080:02000400:3.0:1788526494.802996:0:5804:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788526494.816215:0:5804:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788526494.816229:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788526494.816272:0:5804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000afdf3894) 00000020:00000080:3.0:1788526494.816294:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788526494.872986:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788526494.874288:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788526494.923700:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788526494.923748:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788526494.923770:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788526494.923828:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788526494.923992:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788526494.925622:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788526494.925638:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788526494.925654:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b39eaa 00000020:01000004:0.0:1788526494.925663:0:5804:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788526494.925670:0:5804:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788526494.925676:0:5804:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000317509bf from MGS 00000020:01000004:0.0:1788526494.925681:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788526494.925711:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000aa6a3c7a) 00000020:00000080:0.0:1788526494.925724:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788526494.925841:0:5804:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000317509bf from MGS, refs=2 00080000:01000000:0.0:1788526494.925987:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788526494.925997:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b39eb8 00000100:00100000:0.0:1788526494.926283:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788526494.926601:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788526494.926608:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788526494.929076:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788526494.929141:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788526494.936754:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526494.938291:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788526494.938301:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788526494.941170:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788526494.941207:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788526494.942340:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788526494.942351:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788526494.944259:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526494.944266:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526494.944268:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526494.945257:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526494.945261:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526494.945263:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526494.946029:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788526494.949817:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788526495.195665:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2087 MB/s 00000001:01000000:2.0:1788526495.448887:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5130 MB/s 00000001:01000000:3.0:1788526495.699370:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 947 MB/s 00000001:01000000:3.0:1788526495.949957:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1211 MB/s 00010000:00010000:2.0:1788526495.958883:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788526495.968719:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788526495.993801:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788526495.993826:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788526495.993829:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788526495.998106:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788526495.998187:0:5804:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788526495.998265:0:5804:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788526495.998824:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788526495.998870:0:5804:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788526495.999177:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526495.999670:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788526495.999677:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788526496.002671:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788526496.002687:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788526496.007942:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788526496.007961:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788526496.008991:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788526496.009018:0:5804:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:1.0:1788526496.009020:0:5804:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788526496.009081:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:1.0:1788526496.009107:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (0000000067b8b4c5) 00000020:00000080:1.0:1788526496.009128:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788526496.009237:0:5804:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e211b40f@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1788526496.009476:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:1.0:1788526496.009482:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788526496.010585:0:5819:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788526496.015047:0:5820:0:(mgc_request.c:839:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788526496.015134:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973) 00000020:00000080:1.0:1788526496.015159:0:5804:0:(genops.c:1385:class_connect()) connect: client 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973, cookie 0x367645d450b39ec6 00000100:00080000:1.0:1788526496.015174:0:5804:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788526496.015180:0:5804:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import 00000000e211b40f using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526496.015420:0:5804:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf0c8d3b x1875405881475200/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788526496.015445:0:5804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS 00000020:01000004:1.0:1788526496.015471:0:5804:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788526496.015497:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788526496.015511:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e3a9641d) 00000020:00000080:1.0:1788526496.015524:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788526496.015834:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf0c8d3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881475200:0@lo:250: 00000100:00100000:3.0:1788526496.015927:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526496.016019:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475200 00000100:00100000:3.0:1788526496.016031:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475200 00000100:00100000:3.0:1788526496.016068:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526496.016076:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090cf94f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881475200:12345-0@lo:250: 00010000:00080000:3.0:1788526496.016103:0:5815:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:3.0:1788526496.016127:0:5815:0:(genops.c:1385:class_connect()) connect: client 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973, cookie 0x367645d450b39ed4 00000100:00080000:3.0:1788526496.017302:0:5815:0:(import.c:65:import_set_state_nolock()) 0000000028a97a62 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526496.017554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090cf94f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:3277:x1875405881475200:12345-0@lo:250: Request processed in 1474us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526496.017566:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526496.017666:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788526496.017678:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:3.0:1788526496.017690:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788526496.017697:0:3277:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788526496.017702:0:3277:0:(import.c:65:import_set_state_nolock()) 00000000e211b40f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788526496.017704:0:3277:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788526496.017715:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788526496.017721:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf0c8d3b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881475200:0@lo:250: 00000100:00100000:1.0:1788526496.030875:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526496.031073:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788526496.031080:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788526496.036959:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788526496.036973:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788526496.038773:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788526496.038787:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788526496.040764:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526496.040953:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788526496.040959:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788526496.043114:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788526496.043127:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788526496.108785:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526496.109171:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788526496.109186:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788526496.114245:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788526496.114264:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788526496.115704:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526496.116045:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526496.116058:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788526496.117146:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526496.117159:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788526496.118215:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526496.118797:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526496.118806:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788526496.119871:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526496.120028:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788526496.120871:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526496.121199:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526496.121204:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788526496.122279:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526496.122288:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788526496.175651:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526496.176051:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788526496.176068:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788526496.180775:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788526496.180800:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788526496.185883:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788526496.185964:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788526496.190102:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788526496.190158:0:5804:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788526496.190165:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788526496.190167:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526496.190168:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526496.190169:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526496.190170:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526496.190172:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526496.190173:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526496.190175:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526496.190176:0:5804:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526496.190178:0:5804:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526496.190180:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526496.190186:0:5804:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788526496.190190:0:5804:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788526496.190192:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788526496.190193:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526496.190194:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526496.190195:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526496.190196:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526496.190197:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526496.190198:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526496.190199:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526496.190199:0:5804:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526496.190200:0:5804:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526496.190201:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526496.190692:0:5804:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788526496.190739:0:5804:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788526496.190761:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475328:0@lo:253: 00000100:00100000:2.0:1788526496.190856:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.191028:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5cdd940 going to sleep for 11 seconds 00000100:00100000:3.0:1788526496.191167:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475328 00000100:00100000:3.0:1788526496.191175:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475328 00000100:00100000:3.0:1788526496.191414:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526496.191435:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081dfa679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:5804:x1875405881475328:12345-0@lo:253: 20000000:01000000:3.0:1788526496.191491:0:5818:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788526496.191493:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788526496.192638:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788526496.192718:0:5818:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788526496.193189:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526496.194843:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788526496.195183:0:5818:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788526496.195188:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788526496.195195:0:5818:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788526496.195199:0:5818:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788526496.195215:0:5818:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788526496.195732:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526496.196194:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788526496.196210:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788526496.196490:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788526496.196733:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788526496.196773:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788526496.196874:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788526496.196885:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788526496.197005:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788526496.197013:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788526496.197061:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788526496.197138:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788526496.197175:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788526496.197226:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788526496.197647:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788526496.197654:0:5818:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788526496.197670:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526496.197976:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788526496.197989:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788526496.198024:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788526496.198054:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788526496.198181:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788526496.198195:0:5818:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788526496.198671:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788526496.198684:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788526496.198735:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788526496.198771:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788526496.198829:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788526496.198842:0:5818:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788526496.199207:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788526496.199217:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788526496.199707:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788526496.199756:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788526496.200060:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788526496.200175:0:5818:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788526496.200183:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788526496.201042:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788526496.202034:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788526496.202062:0:5818:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.159@tcp for mdt 20000000:01000000:2.0:1788526496.202064:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:2.0:1788526496.202157:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788526496.202166:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788526496.202190:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788526496.202203:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:2.0:1788526496.202243:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788526496.202377:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788526496.202885:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788526496.203028:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788526496.203687:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788526496.203692:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788526496.203699:0:5818:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788526496.203708:0:5818:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788526496.204964:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1788526496.205262:0:5818:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788526496.220192:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788526496.221845:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788526496.222114:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788526496.222146:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788526496.222150:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788526496.222156:0:5818:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788526496.222176:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788526496.222180:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788526496.222234:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788526496.222237:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788526496.224990:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788526496.226748:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788526496.226823:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788526496.226912:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788526496.226933:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788526496.226937:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788526496.239057:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788526496.239799:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788526496.239850:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788526496.239925:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1788526496.240053:0:5818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788526496.240057:0:5818:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788526496.240064:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788526496.240086:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240118:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240129:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240135:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240141:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240147:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240153:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3ef7e90 already unused, calling callback (0000000002fb7e9e) 00010000:00010000:2.0:1788526496.240156:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240164:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240177:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240183:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.240189:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f3ef7e90/0x367645d450b39edb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788526496.240526:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788526496.534811:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081dfa679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:5804:x1875405881475328:12345-0@lo:253: Request processed in 343369us (343945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526496.534834:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526496.534908:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475328:0@lo:253: 10000000:01000000:2.0:1788526496.534923:0:5804:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788526496.534926:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526496.534928:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526496.534929:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526496.534930:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788526496.534931:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526496.534933:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526496.534934:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526496.534935:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526496.534937:0:5804:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788526496.534939:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526496.534941:0:5804:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788526496.534966:0:5804:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000317509bf from lustre-MDT0000 10000000:01000000:2.0:1788526496.535004:0:5804:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788526496.535007:0:5804:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788526496.535011:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c248515800 10000000:01000000:2.0:1788526496.535017:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526496.535033:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c248515800 from 1 10000000:01000000:2.0:1788526496.535037:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788526496.535080:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.535092:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.535101:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526496.535135:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475456:0@lo:101: 00000100:00100000:2.0:1788526496.535174:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.535225:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:1.0:1788526496.535507:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475456 00000100:00100000:1.0:1788526496.535515:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475456 00000100:00100000:1.0:1788526496.535565:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526496.535574:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9035678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:5804:x1875405881475456:12345-0@lo:101: 00010000:00010000:1.0:1788526496.535589:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526496.535608:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39ee2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526496.535634:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39ee2 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526496.535645:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39ee2 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526496.535655:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc8446be, rc 0) 00000100:00100000:1.0:1788526496.535732:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9035678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5804:x1875405881475456:12345-0@lo:101: Request processed in 159us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526496.535738:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526496.535889:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475456:0@lo:101: 00010000:00010000:2.0:1788526496.535905:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.535915:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526496.535955:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475584:0@lo:501: 00000100:00100000:2.0:1788526496.535992:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.536020:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:0.0:1788526496.536138:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475584 00000100:00100000:0.0:1788526496.536148:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475584 00000100:00100000:0.0:1788526496.536182:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788526496.536187:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3b6774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5804:x1875405881475584:12345-0@lo:501: 00000100:00100000:0.0:1788526496.536491:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3b6774 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5804:x1875405881475584:12345-0@lo:501: Request processed in 304us (499us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526496.536498:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526496.536662:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475584:0@lo:501: 10000000:01000000:2.0:1788526496.536679:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788526496.536700:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.536710:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526496.536719:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c248515800 10000000:01000000:2.0:1788526496.536725:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788526496.536746:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff98c248515800 10000000:01000000:2.0:1788526496.536750:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788526496.536760:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff98c248515800 from 1 10000000:01000000:2.0:1788526496.536771:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788526496.536798:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.536805:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.536812:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526496.536825:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475712:0@lo:101: 00000100:00100000:2.0:1788526496.536852:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.536870:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:0.0:1788526496.537080:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475712 00000100:00100000:0.0:1788526496.537085:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475712 00000100:00100000:0.0:1788526496.537118:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788526496.537125:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005482990a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5804:x1875405881475712:12345-0@lo:101: 00010000:00010000:0.0:1788526496.537135:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526496.537152:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000343394d/0x367645d450b39ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39ef0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.537171:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000343394d/0x367645d450b39ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39ef0 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.537180:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000343394d/0x367645d450b39ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39ef0 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.537186:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000343394d, rc 0) 00000100:00100000:0.0:1788526496.537214:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005482990a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:5804:x1875405881475712:12345-0@lo:101: Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526496.537220:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526496.539576:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475712:0@lo:101: 00010000:00010000:2.0:1788526496.539619:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.539631:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526496.539658:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788526496.539681:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.539689:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000006529044b/0x367645d450b39ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526496.539699:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788526496.539712:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526496.539746:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff98c248515800 10000000:01000000:2.0:1788526496.539772:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788526496.539790:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788526496.539794:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788526496.539839:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.539846:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.539856:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526496.539879:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475840:0@lo:101: 00000100:00100000:2.0:1788526496.540037:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.540079:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:0.0:1788526496.540685:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475840 00000100:00100000:0.0:1788526496.540694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475840 00000100:00100000:0.0:1788526496.540746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788526496.540754:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000e3b8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:5804:x1875405881475840:12345-0@lo:101: 00010000:00010000:0.0:1788526496.540767:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526496.540789:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39efe expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.540815:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39efe expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.540824:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39efe expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526496.540832:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006baf5ca2, rc 0) 00000100:00100000:0.0:1788526496.540884:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000e3b8cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:5804:x1875405881475840:12345-0@lo:101: Request processed in 131us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526496.541012:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475840:0@lo:101: 00010000:00010000:2.0:1788526496.541026:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526496.541034:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526496.541072:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475968:0@lo:501: 00000100:00100000:2.0:1788526496.541101:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.541177:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:0.0:1788526496.541219:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788526496.541262:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881475968 00000100:00100000:0.0:1788526496.541266:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881475968 00000100:00100000:3.0:1788526496.541615:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526496.541626:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd33ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:5804:x1875405881475968:12345-0@lo:501: 00000100:00100000:3.0:1788526496.542969:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd33ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5804:x1875405881475968:12345-0@lo:501: Request processed in 1339us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526496.542996:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526496.543217:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881475968:0@lo:501: 00000100:00100000:2.0:1788526496.543569:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476096:0@lo:503: 00000100:00100000:2.0:1788526496.543640:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.543730:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000009464ad6a going to sleep for 11 seconds 00000100:00100000:0.0:1788526496.543773:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476096 00000100:00100000:0.0:1788526496.543780:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476096 00000100:00100000:0.0:1788526496.543824:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788526496.543830:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087e14ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5804:x1875405881476096:12345-0@lo:503: 00000100:00100000:0.0:1788526496.544145:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087e14ce7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5804:x1875405881476096:12345-0@lo:503: Request processed in 314us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526496.544152:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526496.544253:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476096:0@lo:503: 00000100:00100000:2.0:1788526496.546522:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5845:1875405881476224:0@lo:502: 00000100:00100000:2.0:1788526496.546625:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526496.546717:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4379df6 going to sleep for 11 seconds 00000100:00100000:3.0:1788526496.546764:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476224 00000100:00100000:3.0:1788526496.546771:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476224 00000100:00100000:3.0:1788526496.546820:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788526496.546828:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc50a7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5845:x1875405881476224:12345-0@lo:502: 00000100:00100000:3.0:1788526496.547445:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc50a7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5845:x1875405881476224:12345-0@lo:502: Request processed in 615us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526496.547454:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526496.547561:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5845:1875405881476224:0@lo:502: 00000020:01000000:2.0:1788526496.547598:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526496.547612:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526496.547614:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788526496.547621:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788526496.547624:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788526496.547650:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d33ac3eb) 00000020:00000080:2.0:1788526496.547673:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788526496.547680:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788526496.547833:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788526496.547842:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b39f13 00000020:00000080:2.0:1788526496.548230:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788526496.548236:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526496.548241:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526496.548242:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788526496.548245:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526496.548421:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526496.548424:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788526496.548429:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788526496.548437:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002639e1a2) 00000020:00000080:2.0:1788526496.548448:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788526496.548453:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788526496.548454:0:5845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788526496.548457:0:5845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788526496.548464:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788526496.548523:0:5845:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000317509bf from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788526496.548543:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001c76159f) 00000020:00000080:2.0:1788526496.548551:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788526496.548614:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788526496.548620:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b39f28 00000020:00000080:2.0:1788526496.548709:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788526496.548715:0:5845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788526496.548720:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x367645d450b39f2f 00080000:01000000:2.0:1788526496.548725:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788526496.548729:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b39f36 00080000:10000000:2.0:1788526496.549557:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788526496.549800:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788526496.556818:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788526496.641736:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788526496.644659:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788526496.648844:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788526496.649214:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788526496.687686:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e4b33e60) 00000020:00000080:3.0:1788526496.687709:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788526496.687774:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788526496.687787:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b39f44 00000020:00000080:3.0:1788526496.688118:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788526496.704437:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526496.786491:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526496.916755:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788526496.985193:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788526497.072193:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788526497.189194:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788526497.245789:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788526497.285240:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x367645d450b39f4b 00000020:00000080:1.0:1788526497.286075:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788526497.286090:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526497.286097:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526497.286100:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788526497.286103:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526497.286109:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526497.286111:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788526497.286115:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788526497.286158:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788526497.286173:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526497.286176:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526497.286178:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788526497.286181:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526497.286184:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526497.286185:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788526497.286188:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788526497.286189:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788526497.286237:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013d97993 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5845:1875405881476352:0@lo:502: 00000100:00100000:1.0:1788526497.286350:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526497.286492:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000225e4703 going to sleep for 11 seconds 00000100:00100000:0.0:1788526497.286583:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476352 00000100:00100000:0.0:1788526497.286591:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476352 00000100:00100000:0.0:1788526497.286691:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788526497.286699:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040468cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5845:x1875405881476352:12345-0@lo:502: 00000100:00100000:0.0:1788526497.287293:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040468cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5845:x1875405881476352:12345-0@lo:502: Request processed in 593us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526497.287327:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788526497.287435:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013d97993 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5845:1875405881476352:0@lo:502: 00000020:01000000:3.0:1788526497.287467:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526497.287473:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526497.287475:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788526497.287480:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788526497.287725:0:5804:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788526497.287734:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788526497.287751:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.287764:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526497.287771:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c248515800 from 1 10000000:01000000:3.0:1788526497.287774:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788526497.287823:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.287830:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.287840:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.287858:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476480:0@lo:101: 00000100:00100000:3.0:1788526497.287975:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.288004:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:3.0:1788526497.288041:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476480 00000100:00100000:3.0:1788526497.288047:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476480 00000100:00100000:3.0:1788526497.288072:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526497.288079:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c671d332 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:5804:x1875405881476480:12345-0@lo:101: 00010000:00010000:3.0:1788526497.288089:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526497.288103:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39f52 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.288124:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39f52 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.288134:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f52 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.288143:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005175b1d5, rc 0) 00000100:00100000:3.0:1788526497.288172:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c671d332 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:5804:x1875405881476480:12345-0@lo:101: Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526497.288178:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526497.288215:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476480:0@lo:101: 00010000:00010000:3.0:1788526497.288227:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.288235:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.288818:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476608:0@lo:256: 00000100:00100000:3.0:1788526497.289013:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.289042:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:2.0:1788526497.289067:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476608 00000100:00100000:2.0:1788526497.289072:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476608 00000100:00100000:2.0:1788526497.289095:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526497.289101:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c11bcf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:5804:x1875405881476608:12345-0@lo:256: 20000000:01000000:2.0:1788526497.289117:0:5818:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788526497.289123:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788526497.289289:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c11bcf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:5804:x1875405881476608:12345-0@lo:256: Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.289296:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788526497.289356:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476608:0@lo:256: 10000000:01000000:3.0:1788526497.290225:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788526497.290238:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.290250:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526497.290259:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c248515800 from 1 10000000:01000000:3.0:1788526497.290262:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526497.290288:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.290297:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.290306:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.290338:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476736:0@lo:101: 00000100:00100000:3.0:1788526497.290382:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.290548:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:1.0:1788526497.290593:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476736 00000100:00100000:1.0:1788526497.290600:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476736 00000100:00100000:1.0:1788526497.290644:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788526497.290651:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a570c690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:5804:x1875405881476736:12345-0@lo:101: 00010000:00010000:1.0:1788526497.290673:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526497.290687:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39f60 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.290709:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39f60 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.290719:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f60 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.290727:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d66a7ca7, rc 0) 00000100:00100000:1.0:1788526497.290804:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a570c690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881476736:12345-0@lo:101: Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526497.290811:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526497.291213:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476736:0@lo:101: 00010000:00010000:3.0:1788526497.291232:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.291240:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.291276:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476864:0@lo:501: 00000100:00100000:3.0:1788526497.291313:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.291382:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:2.0:1788526497.291457:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476864 00000100:00100000:2.0:1788526497.291462:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476864 00000100:00100000:2.0:1788526497.291535:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526497.291543:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024f40b1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881476864:12345-0@lo:501: 00000100:00100000:2.0:1788526497.292157:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024f40b1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881476864:12345-0@lo:501: Request processed in 614us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.292170:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788526497.292240:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476864:0@lo:501: 00000100:00100000:3.0:1788526497.292270:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476992:0@lo:503: 00000100:00100000:3.0:1788526497.292308:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.292546:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:1.0:1788526497.292600:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881476992 00000100:00100000:1.0:1788526497.292606:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881476992 00000100:00100000:1.0:1788526497.292631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788526497.292637:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000300c9f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881476992:12345-0@lo:503: 00000040:00080000:1.0:1788526497.292677:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526497.292759:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000300c9f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881476992:12345-0@lo:503: Request processed in 121us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526497.292767:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526497.293020:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881476992:0@lo:503: 00000040:00080000:3.0:1788526497.295453:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788526497.296080:0:5804:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788526497.296095:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526497.296171:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.296186:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526497.296277:0:5804:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788526497.296280:0:5804:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c248515800 10000000:01000000:1.0:1788526497.296285:0:5804:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c248515800 10000000:01000000:1.0:1788526497.296291:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526497.296309:0:5804:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c248515800 from 1 10000000:01000000:1.0:1788526497.296312:0:5804:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526497.296374:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.296382:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.296416:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526497.296437:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000218c431e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477120:0@lo:101: 00000100:00100000:1.0:1788526497.296503:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526497.296549:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3395c56 going to sleep for 11 seconds 00000100:00100000:2.0:1788526497.296630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477120 00000100:00100000:2.0:1788526497.296638:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477120 00000100:00100000:2.0:1788526497.296684:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526497.296692:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6d1b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881477120:12345-0@lo:101: 00010000:00010000:2.0:1788526497.296706:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526497.296720:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39f6e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.296745:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39f6e expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.296757:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f6e expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.296765:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de12da4b, rc 0) 00000100:00100000:2.0:1788526497.296808:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6d1b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477120:12345-0@lo:101: Request processed in 116us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.296815:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788526497.297201:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000218c431e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477120:0@lo:101: 00010000:00010000:3.0:1788526497.297218:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.297226:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.297265:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477248:0@lo:501: 00000100:00100000:3.0:1788526497.297292:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.297329:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000001307bf1d going to sleep for 11 seconds 00000100:00100000:2.0:1788526497.297374:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477248 00000100:00100000:2.0:1788526497.297378:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477248 00000100:00100000:2.0:1788526497.297430:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788526497.297436:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a5688a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477248:12345-0@lo:501: 00000100:00100000:2.0:1788526497.297690:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a5688a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477248:12345-0@lo:501: Request processed in 254us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.297697:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788526497.297776:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dbb3f5fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477248:0@lo:501: 00000100:00100000:1.0:1788526497.297806:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7a7429f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477376:0@lo:503: 00000100:00100000:1.0:1788526497.297846:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526497.297934:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000caed5cdd going to sleep for 11 seconds 00000100:00100000:3.0:1788526497.298078:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477376 00000100:00100000:3.0:1788526497.298083:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477376 00000100:00100000:3.0:1788526497.298112:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526497.298118:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c82d1302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477376:12345-0@lo:503: 00000100:00100000:3.0:1788526497.298468:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c82d1302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477376:12345-0@lo:503: Request processed in 350us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526497.298476:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788526497.298574:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7a7429f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477376:0@lo:503: 00000100:00100000:2.0:1788526497.299280:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5850:1875405881477504:0@lo:502: 00000100:00100000:2.0:1788526497.299361:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526497.299467:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046e45479 going to sleep for 11 seconds 00000100:00100000:3.0:1788526497.299762:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477504 00000100:00100000:3.0:1788526497.299776:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477504 00000100:00100000:3.0:1788526497.299855:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788526497.299862:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7a7f400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5850:x1875405881477504:12345-0@lo:502: 00000100:00100000:3.0:1788526497.300303:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7a7f400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5850:x1875405881477504:12345-0@lo:502: Request processed in 442us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526497.300311:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788526497.300429:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062de9123 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5850:1875405881477504:0@lo:502: 00000020:01000004:0.0:1788526497.300519:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788526497.300538:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000286e712c) 00000020:00000080:0.0:1788526497.300565:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788526497.300677:0:5850:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000317509bf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788526497.300681:0:5850:0:(tgt_mount.c:201:server_put_mount()) put mount 00000000317509bf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788526497.300684:0:5850:0:(obd_mount.c:712:lustre_put_lsi()) put 00000000317509bf 4 00010000:00080000:0.0:1788526497.300724:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002255d19c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1788526497.302774:0:5850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788526497.304095:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788526497.304135:0:5850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788526497.304151:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x367645d450b39f83 00000100:00080000:0.0:1788526497.304162:0:5850:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788526497.304167:0:5850:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002255d19c using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526497.304217:0:5850:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000efdef121 x1875405881477632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788526497.304247:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788526497.306605:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efdef121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881477632:0@lo:38: 00000100:00100000:3.0:1788526497.306706:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526497.311331:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477632 00000100:00100000:2.0:1788526497.311355:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477632 00000100:00100000:2.0:1788526497.311419:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526497.311427:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000272d68a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875405881477632:12345-0@lo:38: 00000100:00100000:2.0:1788526497.311538:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000272d68a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875405881477632:12345-0@lo:38: Request processed in 110us (4832us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788526497.311545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526497.312148:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e6d3d6b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5850:1875405881477760:0@lo:502: 00000100:00100000:3.0:1788526497.312212:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.312253:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 0000000095836140 going to sleep for 11 seconds 00000100:00100000:3.0:1788526497.312291:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788526497.312299:0:3277:0:(import.c:65:import_set_state_nolock()) 000000002255d19c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788526497.312303:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788526497.312307:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efdef121 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881477632:0@lo:38: 00000100:00100000:2.0:1788526497.312412:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477760 00000100:00100000:2.0:1788526497.312417:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477760 00000100:00100000:2.0:1788526497.312448:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788526497.312455:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d385fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5850:x1875405881477760:12345-0@lo:502: 00000100:00100000:2.0:1788526497.312712:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d385fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5850:x1875405881477760:12345-0@lo:502: Request processed in 258us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.312721:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526497.312834:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e6d3d6b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5850:1875405881477760:0@lo:502: 00000040:00080000:1.0:1788526497.312863:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788526497.313195:0:5804:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788526497.313206:0:5804:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788526497.313228:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.313240:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788526497.313295:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788526497.313298:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526497.313299:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526497.313300:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526497.313302:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526497.313303:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526497.313310:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526497.313311:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526497.313313:0:5804:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526497.313314:0:5804:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526497.313325:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526497.313327:0:5804:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526497.313330:0:5804:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788526497.313333:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788526497.313334:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526497.313335:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526497.313336:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526497.313337:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526497.313338:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526497.313339:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526497.313339:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526497.313340:0:5804:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526497.313341:0:5804:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526497.313342:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526497.313343:0:5804:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526497.313361:0:5804:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788526497.313371:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000503cf3c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477888:0@lo:253: 00000100:00100000:2.0:1788526497.313450:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526497.313479:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4379df6 going to sleep for 11 seconds 00000100:00100000:1.0:1788526497.313596:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881477888 00000100:00100000:1.0:1788526497.313607:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881477888 00000100:00100000:1.0:1788526497.313638:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788526497.313644:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d6304a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5804:x1875405881477888:12345-0@lo:253: 20000000:01000000:1.0:1788526497.313666:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788526497.313681:0:5815:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788526497.357811:0:5815:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788526497.357834:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788526497.357951:0:5838:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788526497.357956:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788526497.357979:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.357999:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f52 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.358006:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.358051:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526497.358087:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 12 pid: 5818 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.358104:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021172fb5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881478016:0@lo:104: 00000100:00100000:3.0:1788526497.358178:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526497.358243:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004e640 going to sleep for 11 seconds 00000100:00100000:0.0:1788526497.358470:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478016 00000100:00100000:0.0:1788526497.358479:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478016 00000100:00100000:0.0:1788526497.358613:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526497.358622:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c0cf5c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881478016:12345-0@lo:104: 00010000:00010000:0.0:1788526497.358635:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526497.358717:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788526497.358722:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c0cf5c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881478016:12345-0@lo:104: Request processed in 102us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526497.358737:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788526497.358759:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526497.358765:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526497.358775:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073eb4ab7 already unused, calling callback (00000000b7a625ae) 10000000:00010000:0.0:1788526497.358779:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526497.358787:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526497.358794:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526497.358799:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788526497.358827:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526497.358834:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788526497.358853:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526497.358859:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 0000000073eb4ab7/0x367645d450b39f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f59 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526497.359051:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021172fb5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881478016:0@lo:104: 00010000:00010000:2.0:1788526497.359076:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526497.359622:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526497.359637:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b0091c8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881478144:0@lo:103: 00000100:00100000:3.0:1788526497.359684:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526497.359778:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526497.359781:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526497.359782:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526497.360360:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478144 00000100:00100000:2.0:1788526497.360368:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478144 00010000:00010000:2.0:1788526497.360420:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 13 pid: 5818 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526497.360458:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526497.360467:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000da0397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:3278:x1875405881478144:12345-0@lo:103: 00010000:00010000:2.0:1788526497.360488:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526497.360493:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 13 pid: 5818 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360505:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 13 pid: 5818 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360521:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005175b1d5/0x367645d450b39f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39f52 expref: 13 pid: 5818 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360534:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360543:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788526497.360558:0:5808:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002602471s 00010000:00010000:2.0:1788526497.360562:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360568:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360573:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360579:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360585:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ef053281 already unused, calling callback (0000000002fb7e9e) 00010000:00010000:2.0:1788526497.360589:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360603:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360621:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526497.360632:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526497.360682:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000da0397d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3278:x1875405881478144:12345-0@lo:103: Request processed in 216us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526497.360689:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526497.360782:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b0091c8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881478144:0@lo:103: 00010000:00010000:1.0:1788526497.361221:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.361232:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526497.361239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef053281/0x367645d450b39f8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526497.372612:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d6304a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5804:x1875405881477888:12345-0@lo:253: Request processed in 58952us (59146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526497.372634:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788526497.372754:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000503cf3c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5804:1875405881477888:0@lo:253: 10000000:01000000:2.0:1788526497.372774:0:5804:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788526497.372777:0:5804:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526497.372781:0:5804:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788526497.372783:0:5804:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526497.372784:0:5804:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526497.372785:0:5804:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526497.372786:0:5804:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526497.372788:0:5804:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788526497.372790:0:5804:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788526497.372792:0:5804:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526497.372793:0:5804:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526497.372795:0:5804:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526497.372796:0:5804:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788526497.372818:0:5804:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788526497.379863:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.380631:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526497.381087:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.381280:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526497.381559:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.381822:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526497.382677:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.382940:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526497.383264:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.383561:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526497.383768:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526497.384165:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788526497.422141:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788526497.459093:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788526497.459431:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788526497.462368:0:5855:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788526497.462399:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788526497.463413:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788526497.463713:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788526497.464190:0:5804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788526497.464198:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788526497.464373:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526497.465714:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788526497.466274:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788526497.466309:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788526497.466676:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788526497.467138:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788526497.468852:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788526497.472064:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788526497.472331:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788526497.472544:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788526497.472725:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788526497.472870:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788526497.479751:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788526497.482212:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788526497.482477:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788526497.482622:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788526497.482761:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788526497.482897:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788526497.483046:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788526497.483189:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788526497.483365:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788526497.483553:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788526497.483889:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788526497.484028:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788526497.484191:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788526497.484346:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788526497.484530:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788526497.486426:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788526497.486633:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788526497.486797:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788526497.486949:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788526497.487296:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788526497.487549:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788526497.487710:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788526497.487861:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788526497.488278:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788526497.489123:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788526497.489300:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788526497.489852:0:5804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788526497.509795:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788526497.544239:0:5804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788526497.544283:0:5804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaec7018b79b8 00100000:10000000:0.0:1788526497.544292:0:5804:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788526497.544765:0:5804:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788526497.544799:0:5804:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788526497.604175:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788526497.604789:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788526497.604795:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788526498.003871:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526499.033362:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526500.051845:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526501.076561:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526502.099484:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788526502.357008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788526502.357019:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788526502.357022:0:36:0:(import.c:65:import_set_state_nolock()) 000000002255d19c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788526502.357035:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002255d19c using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1788526502.357059:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000466cf5be x1875405881478400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788526502.357106:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000466cf5be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881478400:0@lo:38: 00000100:00100000:2.0:1788526502.357177:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526502.357338:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526502.357346:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000503cf3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881478272:0@lo:400: 00000100:00100000:3.0:1788526502.357425:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526502.357526:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478400 00000100:00100000:1.0:1788526502.357534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478400 00000100:00100000:1.0:1788526502.357564:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526502.357570:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bb76a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875405881478400:12345-0@lo:38: 00010000:00080000:1.0:1788526502.357595:0:5824:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1788526502.357632:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x367645d450b39f91 00000004:00100000:1.0:1788526502.357681:0:5824:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788526502.357833:0:5824:0:(import.c:65:import_set_state_nolock()) 000000006afcafae : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526502.358089:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bb76a7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875405881478400:12345-0@lo:38: Request processed in 517us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526502.358096:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788526502.358583:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000466cf5be x1875405881478400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788526502.358600:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788526502.358607:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788526502.358612:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788526502.358614:0:3277:0:(import.c:65:import_set_state_nolock()) 000000002255d19c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788526502.358620:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000466cf5be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881478400:0@lo:38: 00000100:00100000:2.0:1788526502.359474:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478272 00000100:00100000:2.0:1788526502.359491:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478272 00000100:00100000:2.0:1788526502.359532:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788526502.359539:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7ef1232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3281:x1875405881478272:12345-0@lo:400: 00000100:00100000:2.0:1788526502.359614:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7ef1232 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3281:x1875405881478272:12345-0@lo:400: Request processed in 75us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526502.359629:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788526502.359780:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000503cf3c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881478272:0@lo:400: 00010000:00010000:0.0:1788526503.124052:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788526503.380984:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788526503.380991:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c248515800 from 3 10000000:01000000:3.0:1788526503.380996:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788526503.381038:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.381049:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.381059:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526503.381081:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881478528:0@lo:101: 00000100:00100000:3.0:1788526503.381141:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526503.381191:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d965f4d going to sleep for 11 seconds 00000100:00100000:3.0:1788526503.381314:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478528 00000100:00100000:3.0:1788526503.381321:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478528 00000100:00100000:3.0:1788526503.381367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788526503.381374:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022f624c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:5820:x1875405881478528:12345-0@lo:101: 00010000:00010000:3.0:1788526503.381405:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526503.381955:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005175b1d5/0x367645d450b39f9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39f98 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.381979:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005175b1d5/0x367645d450b39f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39f98 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.381990:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005175b1d5/0x367645d450b39f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f98 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.382000:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005175b1d5, rc 0) 00000100:00100000:3.0:1788526503.382057:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022f624c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5820:x1875405881478528:12345-0@lo:101: Request processed in 683us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526503.382064:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788526503.382116:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881478528:0@lo:101: 00010000:00010000:3.0:1788526503.382130:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.382139:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526503.382186:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881478656:0@lo:256: 00000100:00100000:3.0:1788526503.382231:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526503.382318:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d965f4d going to sleep for 11 seconds 00000100:00100000:3.0:1788526503.382333:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478656 00000100:00100000:3.0:1788526503.382338:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478656 00000100:00100000:3.0:1788526503.382377:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788526503.382383:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000906e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5820:x1875405881478656:12345-0@lo:256: 20000000:01000000:3.0:1788526503.382743:0:5817:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788526503.382763:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788526503.382769:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788526503.382973:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000906e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5820:x1875405881478656:12345-0@lo:256: Request processed in 589us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526503.382980:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788526503.383013:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881478656:0@lo:256: 10000000:01000000:3.0:1788526503.383051:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788526503.383056:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526503.383064:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000ef053281/0x367645d450b39f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526504.147509:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788526504.752514:0:6099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788526505.173574:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526506.195616:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526507.223038:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526507.480530:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526507.480556:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881478784:0@lo:400: 00000100:00100000:1.0:1788526507.480630:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526507.480737:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f689ff51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881478912:0@lo:400: 00000100:00100000:2.0:1788526507.480778:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526507.481086:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478912 00000100:00100000:1.0:1788526507.481093:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478912 00000100:00100000:1.0:1788526507.481151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526507.481159:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6446d91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881478912:12345-0@lo:400: 00000100:00100000:1.0:1788526507.481213:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6446d91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881478912:12345-0@lo:400: Request processed in 55us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526507.481220:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788526507.481455:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f689ff51 x1875405881478912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526507.481469:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f689ff51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881478912:0@lo:400: 00000100:00100000:3.0:1788526507.481526:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881478784 00000100:00100000:3.0:1788526507.481530:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881478784 00000100:00100000:3.0:1788526507.481562:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788526507.481568:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000170e8711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3280:x1875405881478784:12345-0@lo:400: 00000100:00100000:3.0:1788526507.481605:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000170e8711 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3280:x1875405881478784:12345-0@lo:400: Request processed in 38us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526507.481611:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788526507.481872:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d8c4ce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881478784:0@lo:400: 00010000:00010000:0.0:1788526508.244803:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526509.275632:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526510.293091:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788526510.605332:0:6301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe45d090b0 20000000:00000080:1.0:1788526510.605357:0:6301:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c24961a000 uarg=0000000000000000 20000000:01000000:1.0:1788526510.605568:0:6301:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788526510.605576:0:6301:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788526510.605581:0:6301:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788526510.605830:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788526510.605843:0:6301:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788526510.615853:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788526510.616151:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788526510.616220:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788526510.616272:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788526510.616293:0:6301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788526510.616311:0:6301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.616341:0:6301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f60 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.616349:0:6301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.616437:0:6301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.616453:0:6301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 11 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526510.616470:0:6301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7a7429f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875405881479040:0@lo:104: 00000100:00100000:1.0:1788526510.616557:0:6301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526510.616618:0:6301:0:(client.c:2716:ptlrpc_set_wait()) set 00000000005fe377 going to sleep for 11 seconds 00000100:00100000:2.0:1788526510.616816:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479040 00000100:00100000:2.0:1788526510.616826:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479040 00000100:00100000:2.0:1788526510.616888:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526510.616897:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050197513 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:6301:x1875405881479040:12345-0@lo:104: 00010000:00010000:2.0:1788526510.616911:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526510.617051:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526510.617067:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050197513 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:6301:x1875405881479040:12345-0@lo:104: Request processed in 163us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526510.617075:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788526510.617127:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526510.617136:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526510.617144:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003746efb2 already unused, calling callback (00000000b7a625ae) 10000000:00010000:0.0:1788526510.617149:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526510.617157:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526510.617164:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526510.617179:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788526510.617253:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526510.617262:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788526510.617287:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526510.617293:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 000000003746efb2/0x367645d450b39f60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f67 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526510.617310:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526510.617313:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526510.617314:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526510.617376:0:6301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7a7429f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875405881479040:0@lo:104: 00010000:00010000:1.0:1788526510.617447:0:6301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526510.617566:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000008654f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881479168:0@lo:103: 00000100:00100000:2.0:1788526510.617603:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526510.617782:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479168 00000100:00100000:1.0:1788526510.617790:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479168 00010000:00010000:1.0:1788526510.617810:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526510.617840:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526510.617848:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014a02bcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3279:x1875405881479168:12345-0@lo:103: 00010000:00010000:1.0:1788526510.617859:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526510.617863:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617879:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617892:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d66a7ca7/0x367645d450b39f67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39f60 expref: 12 pid: 5817 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617903:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617910:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617921:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617927:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617932:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617937:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617943:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed6f1c78 already unused, calling callback (0000000002fb7e9e) 00010000:00010000:1.0:1788526510.617946:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617954:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617983:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526510.617994:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526510.618024:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014a02bcd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3279:x1875405881479168:12345-0@lo:103: Request processed in 178us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526510.618031:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526510.618107:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000008654f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881479168:0@lo:103: 00010000:00010000:2.0:1788526510.618127:0:6301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526510.618134:0:6301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526510.618150:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed6f1c78/0x367645d450b39fa6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526511.315656:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526512.339505:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526512.595988:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526512.596079:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526512.596103:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000882536e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881479424:0@lo:400: 00000100:00100000:1.0:1788526512.596212:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526512.596452:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479424 00000100:00100000:2.0:1788526512.596464:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479424 00000100:00100000:2.0:1788526512.596528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526512.596539:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a7429f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881479424:12345-0@lo:400: 00000100:00100000:2.0:1788526512.596600:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a7429f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881479424:12345-0@lo:400: Request processed in 63us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526512.596607:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788526512.596713:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000882536e8 x1875405881479424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526512.596727:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000882536e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881479424:0@lo:400: 00000100:00100000:1.0:1788526512.599156:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de7689c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881479296:0@lo:400: 00000100:00100000:1.0:1788526512.599257:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526512.599981:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479296 00000100:00100000:0.0:1788526512.599991:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479296 00000100:00100000:0.0:1788526512.600064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788526512.600072:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055f5321b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3281:x1875405881479296:12345-0@lo:400: 00000100:00100000:0.0:1788526512.600144:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055f5321b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3281:x1875405881479296:12345-0@lo:400: Request processed in 73us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526512.600152:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788526512.600653:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de7689c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881479296:0@lo:400: 00010000:00010000:2.0:1788526513.380521:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526514.397748:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526515.412205:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526516.435706:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526517.461455:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526517.718252:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aae03aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881479552:0@lo:400: 00000100:00100000:3.0:1788526517.718326:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526517.718442:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479552 00000100:00100000:1.0:1788526517.718451:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479552 00000100:00100000:1.0:1788526517.718502:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788526517.718510:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006770119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3278:x1875405881479552:12345-0@lo:400: 00000100:00100000:1.0:1788526517.722028:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006770119a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3278:x1875405881479552:12345-0@lo:400: Request processed in 3507us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526517.722104:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788526517.722268:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aae03aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881479552:0@lo:400: 00000100:00100000:3.0:1788526517.722294:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526517.722305:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b5cfa2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881479680:0@lo:400: 00000100:00100000:3.0:1788526517.722369:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526517.728147:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479680 00000100:00100000:1.0:1788526517.728163:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479680 00000100:00100000:1.0:1788526517.728236:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526517.728244:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000791388d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881479680:12345-0@lo:400: 00000100:00100000:1.0:1788526517.728357:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000791388d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881479680:12345-0@lo:400: Request processed in 115us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526517.728366:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788526517.728715:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006b5cfa2d x1875405881479680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526517.728731:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b5cfa2d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881479680:0@lo:400: 00010000:00010000:3.0:1788526518.498105:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788526518.632895:0:6665:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788526518.632900:0:6665:0:(obd_mount.c:928:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788526518.633050:0:6665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005018537c 00000020:01000004:3.0:1788526518.633068:0:6665:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788526518.633081:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788526518.633095:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000004cb08811) 00000020:00000080:3.0:1788526518.633111:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788526518.702637:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788526518.703591:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788526518.778214:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788526518.801667:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788526518.801706:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788526518.801765:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788526518.801793:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788526518.802159:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788526518.802170:0:6665:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788526518.802180:0:6665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x367645d450b39fb4 00000020:01000004:3.0:1788526518.802188:0:6665:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788526518.802211:0:6665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788526518.802214:0:6665:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788526518.802219:0:6665:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788526518.802224:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788526518.802234:0:6665:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000009b18ef5a) 00000020:00000080:3.0:1788526518.802244:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788526518.817508:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526518.818673:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788526518.818683:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788526518.831210:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788526518.831240:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788526518.832106:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788526518.832115:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788526518.834361:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526518.834708:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788526518.834721:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788526518.848552:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788526518.848571:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788526518.912482:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526518.913596:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788526518.913605:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788526518.918434:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788526518.918449:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788526518.919324:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788526518.919333:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788526518.927026:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788526518.927221:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788526518.927682:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788526518.929626:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788526518.929637:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788526519.015497:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526519.015830:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788526519.015836:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788526519.023999:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788526519.026379:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788526519.027182:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788526519.027226:0:6665:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788526519.027505:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788526519.027508:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526519.027510:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526519.027511:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526519.027512:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526519.027514:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526519.027516:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526519.027517:0:6665:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788526519.027519:0:6665:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788526519.027520:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526519.027521:0:6665:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526519.027525:0:6665:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788526519.027528:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788526519.027529:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526519.027530:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526519.027531:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526519.027532:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526519.027533:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526519.027534:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526519.027535:0:6665:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788526519.027536:0:6665:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788526519.027551:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526519.027551:0:6665:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526519.027582:0:6665:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788526519.027597:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c5b2f07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881479808:0@lo:253: 00000100:00100000:1.0:1788526519.027668:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.027728:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018013007 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.027828:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479808 00000100:00100000:3.0:1788526519.027836:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479808 00000100:00100000:3.0:1788526519.027878:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788526519.027886:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016fb88ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881479808:12345-0@lo:253: 20000000:01000000:3.0:1788526519.027932:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788526519.027937:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788526519.027942:0:5818:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788526519.027945:0:5818:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788526519.028868:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526519.029100:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788526519.029113:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788526519.029147:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788526519.029153:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788526519.029177:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788526519.029215:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788526519.029575:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788526519.029593:0:5818:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1788526519.029595:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1788526519.029622:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788526519.029628:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788526519.029664:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788526519.029671:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1788526519.029701:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788526519.029709:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788526519.029734:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788526519.029783:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788526519.030563:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788526519.030579:0:5818:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1788526519.030581:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1788526519.030609:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788526519.030614:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788526519.030638:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788526519.030644:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1788526519.037538:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788526519.037693:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788526519.037733:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788526519.037766:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788526519.037790:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788526519.037793:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788526519.037797:0:5818:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788526519.037812:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788526519.037815:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788526519.037862:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788526519.037865:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788526519.039184:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788526519.044101:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788526519.044151:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788526519.044214:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788526519.044227:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788526519.045534:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788526519.046878:0:6682:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788526519.046977:0:6682:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788526519.047026:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788526519.047993:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788526519.048046:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788526519.048077:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788526519.048090:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788526519.048093:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788526519.049672:0:6683:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788526519.049744:0:6683:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788526519.049787:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788526519.050132:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788526519.050166:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788526519.050255:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788526519.050273:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788526519.050280:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788526519.050289:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788526519.050310:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050333:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39ee2 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050341:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050348:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f6e expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050355:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050427:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050443:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.050458:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ad4ca6a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881479936:0@lo:104: 00000100:00100000:3.0:1788526519.050520:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788526519.050787:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050795:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.050804:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000099d1143d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881480064:0@lo:104: 00000100:00100000:3.0:1788526519.050828:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788526519.050959:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.050967:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 11 pid: 5817 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.050974:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec3348a5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881480192:0@lo:104: 00000100:00100000:3.0:1788526519.050993:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526519.051162:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881479936 00000100:00100000:2.0:1788526519.051170:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881479936 00000100:00100000:2.0:1788526519.051213:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480064 00000100:00100000:2.0:1788526519.051216:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480064 00000100:00100000:2.0:1788526519.051229:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526519.051326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000894e44c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:5818:x1875405881479936:12345-0@lo:104: 00010000:00010000:2.0:1788526519.051339:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.051495:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526519.051502:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000894e44c7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:5818:x1875405881479936:12345-0@lo:104: Request processed in 177us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.051509:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526519.051528:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526519.051534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000360829de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881480064:12345-0@lo:104: 00010000:00010000:2.0:1788526519.051549:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.051652:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000801fd6a0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.051678:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ad4ca6a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881479936:0@lo:104: 00000100:00100000:3.0:1788526519.051687:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000099d1143d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881480064:0@lo:104: 00010000:00010000:1.0:1788526519.051783:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526519.051788:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051796:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000731138e2 already unused, calling callback (00000000b7a625ae) 10000000:00010000:1.0:1788526519.051799:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051807:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526519.051814:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526519.051820:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788526519.051850:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051857:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526519.051878:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051884:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000731138e2/0x367645d450b39f6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f75 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051907:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526519.051909:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051915:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006dad51f2 already unused, calling callback (00000000b7a625ae) 10000000:00010000:1.0:1788526519.051917:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051923:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526519.051928:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526519.051933:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788526519.051945:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051950:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526519.051954:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051959:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 000000006dad51f2/0x367645d450b39efe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f05 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.051968:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526519.051976:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526519.051978:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526519.051991:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b315535b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881480320:0@lo:103: 00000100:00100000:1.0:1788526519.052021:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.052044:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526519.052049:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881480448:0@lo:103: 00000100:00100000:1.0:1788526519.052064:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.052089:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480320 00000100:00100000:1.0:1788526519.052093:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480320 00010000:00010000:1.0:1788526519.052110:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 12 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526519.052127:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480448 00000100:00100000:1.0:1788526519.052130:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480448 00010000:00010000:1.0:1788526519.052139:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39efe expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526519.052151:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526519.052156:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b55e6f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:3280:x1875405881480320:12345-0@lo:103: 00010000:00010000:1.0:1788526519.052166:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526519.052170:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052179:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052192:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de12da4b/0x367645d450b39f75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39f6e expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052203:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526519.052380:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b55e6f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3280:x1875405881480320:12345-0@lo:103: Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.052409:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526519.052423:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526519.052428:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000790a5fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:3280:x1875405881480448:12345-0@lo:103: 00010000:00010000:1.0:1788526519.052435:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526519.052438:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052446:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052455:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006baf5ca2/0x367645d450b39f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39efe expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.052464:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526519.052482:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000790a5fa5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:3280:x1875405881480448:12345-0@lo:103: Request processed in 54us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.052488:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526519.052511:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881480448:0@lo:103: 00000100:00100000:1.0:1788526519.052518:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b315535b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881480320:0@lo:103: 00010000:00010000:2.0:1788526519.052722:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788526519.052728:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000360829de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881480064:12345-0@lo:104: Request processed in 1195us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.052734:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526519.052748:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480192 00000100:00100000:2.0:1788526519.052751:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480192 00000100:00100000:2.0:1788526519.052766:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526519.052771:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b88b64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881480192:12345-0@lo:104: 00010000:00010000:2.0:1788526519.052779:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526519.052853:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec3348a5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881480192:0@lo:104: 00010000:00010000:1.0:1788526519.052871:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.052960:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526519.052965:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.052972:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3ef7e90 already unused, calling callback (00000000b7a625ae) 10000000:00010000:3.0:1788526519.052974:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.052980:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526519.052986:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526519.052992:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788526519.053050:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053068:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526519.053092:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053098:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000f3ef7e90/0x367645d450b39ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39ee9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053110:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526519.053111:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526519.053112:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526519.053148:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881480576:0@lo:103: 00000100:00100000:1.0:1788526519.053174:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526519.053363:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480576 00000100:00100000:3.0:1788526519.053367:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480576 00010000:00010000:3.0:1788526519.053383:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 10 pid: 5817 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.053428:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526519.053434:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b315535b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:3278:x1875405881480576:12345-0@lo:103: 00010000:00010000:3.0:1788526519.053442:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526519.053446:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 10 pid: 5817 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053454:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 10 pid: 5817 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053465:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc8446be/0x367645d450b39ee9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39ee2 expref: 10 pid: 5817 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053477:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053496:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053508:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053515:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053521:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053526:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053531:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002d61f366 already unused, calling callback (0000000002fb7e9e) 00010000:00010000:3.0:1788526519.053535:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053648:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053664:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.053674:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526519.053706:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b315535b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:3278:x1875405881480576:12345-0@lo:103: Request processed in 273us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526519.053713:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788526519.053765:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881480576:0@lo:103: 00010000:00010000:1.0:1788526519.053783:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.053790:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.053796:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002d61f366/0x367645d450b39fc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788526519.053808:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788526519.057066:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788526519.057090:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b88b64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881480192:12345-0@lo:104: Request processed in 4312us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.057104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788526519.057905:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526519.109925:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016fb88ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:6665:x1875405881479808:12345-0@lo:253: Request processed in 82029us (82247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.109943:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788526519.110075:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c5b2f07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881479808:0@lo:253: 10000000:01000000:2.0:1788526519.110096:0:6665:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788526519.110113:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526519.110115:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788526519.110117:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526519.110118:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788526519.110120:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526519.110121:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526519.110122:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526519.110124:0:6665:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788526519.110125:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526519.110126:0:6665:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788526519.110142:0:6665:0:(tgt_mount.c:115:server_register_mount()) register mount 000000005018537c from lustre-OST0000 10000000:01000000:2.0:1788526519.110167:0:6665:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788526519.110170:0:6665:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788526519.110176:0:6665:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c27453b800 10000000:01000000:2.0:1788526519.110181:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526519.110207:0:6665:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788526519.115638:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788526519.136514:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788526519.136532:0:6665:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c27453b800 from 1 10000000:01000000:0.0:1788526519.136536:0:6665:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788526519.136581:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.136595:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.136608:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.136632:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480704:0@lo:101: 00000100:00100000:0.0:1788526519.136705:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.136754:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4379df6 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.137732:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480704 00000100:00100000:2.0:1788526519.137742:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480704 00000100:00100000:2.0:1788526519.137797:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526519.137805:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce3426c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:6665:x1875405881480704:12345-0@lo:101: 00010000:00010000:2.0:1788526519.137819:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526519.137834:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000373fc77c/0x367645d450b39fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39fc9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.137857:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000373fc77c/0x367645d450b39fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39fc9 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.137867:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000373fc77c/0x367645d450b39fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39fc9 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.137876:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000373fc77c, rc 0) 00000100:00100000:2.0:1788526519.137946:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce3426c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881480704:12345-0@lo:101: Request processed in 142us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.137963:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788526519.138106:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480704:0@lo:101: 00010000:00010000:0.0:1788526519.138122:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.138131:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.138214:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480832:0@lo:501: 00000100:00100000:0.0:1788526519.138242:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.138273:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4379df6 going to sleep for 11 seconds 00000100:00100000:1.0:1788526519.138326:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480832 00000100:00100000:1.0:1788526519.138331:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480832 00000100:00100000:1.0:1788526519.138361:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788526519.138367:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037950324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881480832:12345-0@lo:501: 00000100:00100000:1.0:1788526519.138599:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037950324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881480832:12345-0@lo:501: Request processed in 232us (356us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526519.138606:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788526519.138710:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480832:0@lo:501: 10000000:01000000:0.0:1788526519.138724:0:6665:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788526519.138764:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480960:0@lo:501: 00000100:00100000:0.0:1788526519.138785:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.138808:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4379df6 going to sleep for 11 seconds 00000100:00100000:1.0:1788526519.138855:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881480960 00000100:00100000:1.0:1788526519.138859:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881480960 00000100:00100000:1.0:1788526519.138891:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788526519.138906:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e5216f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881480960:12345-0@lo:501: 00000100:00100000:1.0:1788526519.139015:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e5216f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881480960:12345-0@lo:501: Request processed in 109us (229us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526519.139021:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788526519.139087:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881480960:0@lo:501: 10000000:01000000:0.0:1788526519.139112:0:6665:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788526519.139131:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.139141:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000005ed6eb8c/0x367645d450b39fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526519.139151:0:6665:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c27453b800 10000000:01000000:0.0:1788526519.139156:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788526519.139175:0:6665:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788526519.139255:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788526519.139262:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788526519.139269:0:6665:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff98c249711980 10000000:01000000:0.0:1788526519.139272:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788526519.139283:0:6665:0:(mgc_request.c:2062:mgc_process_log()) Process log nodemap-ffff98c249711980 from 1 10000000:01000000:0.0:1788526519.139285:0:6665:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788526519.139306:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.139313:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.139322:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.139332:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481088:0@lo:101: 00000100:00100000:0.0:1788526519.139360:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.139528:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 000000007cda1975 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.139890:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481088 00000100:00100000:2.0:1788526519.139905:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481088 00000100:00100000:2.0:1788526519.139938:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788526519.139944:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b2c6f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:6665:x1875405881481088:12345-0@lo:101: 00010000:00010000:2.0:1788526519.139953:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526519.139966:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055edbf6f/0x367645d450b39fde lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39fd7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.139986:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055edbf6f/0x367645d450b39fde lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39fd7 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.139996:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055edbf6f/0x367645d450b39fde lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39fd7 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.140003:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055edbf6f, rc 0) 00000100:00100000:2.0:1788526519.140045:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b2c6f94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:6665:x1875405881481088:12345-0@lo:101: Request processed in 101us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.140051:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788526519.140227:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481088:0@lo:101: 00010000:00010000:0.0:1788526519.140249:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.140257:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526519.140271:0:6665:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788526519.140283:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.140290:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000a820c50b/0x367645d450b39fd7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526519.140296:0:6665:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788526519.140300:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788526519.140315:0:6665:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788526519.140382:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788526519.140418:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788526519.140423:0:6665:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788526519.140426:0:6665:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788526519.140442:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.140448:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.140456:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.140474:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481216:0@lo:101: 00000100:00100000:0.0:1788526519.140504:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.140518:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 000000005feeae85 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.140644:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481216 00000100:00100000:2.0:1788526519.140648:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481216 00000100:00100000:2.0:1788526519.140668:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788526519.140673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000293621c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:6665:x1875405881481216:12345-0@lo:101: 00010000:00010000:2.0:1788526519.140680:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526519.140688:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003632a6f6/0x367645d450b39fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b39fe5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.140702:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003632a6f6/0x367645d450b39fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b39fe5 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.140716:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003632a6f6/0x367645d450b39fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39fe5 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.140722:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003632a6f6, rc 0) 00000100:00100000:2.0:1788526519.140746:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000293621c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481216:12345-0@lo:101: Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.140752:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788526519.141700:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481216:0@lo:101: 00010000:00010000:0.0:1788526519.141719:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.141727:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.141821:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481344:0@lo:501: 00000100:00100000:0.0:1788526519.141859:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.141889:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 000000005feeae85 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.141985:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481344 00000100:00100000:2.0:1788526519.141991:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481344 00000100:00100000:2.0:1788526519.142027:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526519.142035:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c3940e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481344:12345-0@lo:501: 00000100:00100000:2.0:1788526519.142289:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c3940e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481344:12345-0@lo:501: Request processed in 255us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.142298:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788526519.142371:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c45367da pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481344:0@lo:501: 00000100:00100000:1.0:1788526519.142427:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481472:0@lo:503: 00000100:00100000:1.0:1788526519.142462:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.142478:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c998a371 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.142580:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481472 00000100:00100000:2.0:1788526519.142584:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481472 00000100:00100000:2.0:1788526519.142599:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788526519.142604:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f639058b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481472:12345-0@lo:503: 00000100:00100000:2.0:1788526519.142737:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f639058b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481472:12345-0@lo:503: Request processed in 132us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.142743:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788526519.142886:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481472:0@lo:503: 00000040:00080000:1.0:1788526519.143177:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526519.143247:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481600:0@lo:502: 00000100:00100000:1.0:1788526519.143281:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.143307:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c998a371 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.143410:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481600 00000100:00100000:2.0:1788526519.143415:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481600 00000100:00100000:2.0:1788526519.143431:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788526519.143436:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000010f1c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481600:12345-0@lo:502: 00000100:00100000:2.0:1788526519.143549:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000010f1c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481600:12345-0@lo:502: Request processed in 113us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.143560:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788526519.143624:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481600:0@lo:502: 00000040:00080000:1.0:1788526519.143844:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788526519.143883:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788526519.143924:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788526519.143963:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788526519.143994:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788526519.144037:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788526519.144056:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481728:0@lo:502: 00000100:00100000:1.0:1788526519.144088:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.144115:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c998a371 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.144211:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481728 00000100:00100000:2.0:1788526519.144216:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481728 00000100:00100000:2.0:1788526519.144243:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788526519.144248:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000725cd7fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481728:12345-0@lo:502: 00000100:00100000:2.0:1788526519.144356:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000725cd7fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481728:12345-0@lo:502: Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.144362:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788526519.147912:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e26dea8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481728:0@lo:502: 00000040:00080000:1.0:1788526519.148095:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788526519.148110:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788526519.148977:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788526519.148987:0:6684:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788526519.148994:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526519.148997:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788526519.149003:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788526519.149023:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000009397d828) 00000020:00000080:1.0:1788526519.149043:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788526519.149048:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788526519.149103:0:6684:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005018537c from lustre-OST0000, refs=2 00080000:01000000:1.0:1788526519.149109:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788526519.149115:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x367645d450b39ffa 00010000:00010000:1.0:1788526519.156025:0:6684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788526519.156336:0:6684:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788526519.161549:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788526519.161983:0:6684:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788526519.171204:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788526519.172104:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788526519.174581:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788526519.174596:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526519.174603:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526519.174605:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788526519.174608:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526519.174612:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526519.174613:0:6684:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788526519.174617:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788526519.174619:0:6684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788526519.174683:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526519.174687:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526519.174689:0:6684:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788526519.174693:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788526519.174975:0:6665:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788526519.174991:0:6665:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788526519.175013:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175028:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000006baf5ca2/0x367645d450b39fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526519.175037:0:6665:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27453b800 from 1 10000000:01000000:2.0:1788526519.175040:0:6665:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788526519.175084:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000076585aeb/0x367645d450b3a001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175092:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000076585aeb/0x367645d450b3a001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175102:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000076585aeb/0x367645d450b3a001 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526519.175125:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000078a0916 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481856:0@lo:101: 00000100:00100000:2.0:1788526519.175330:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526519.175434:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045f9254c going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.175689:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481856 00000100:00100000:2.0:1788526519.175698:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481856 00000100:00100000:2.0:1788526519.175790:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788526519.175799:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7aea801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:6665:x1875405881481856:12345-0@lo:101: 00010000:00010000:2.0:1788526519.175812:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526519.175827:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040d53232/0x367645d450b3a008 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a001 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175848:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040d53232/0x367645d450b3a008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a001 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175857:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040d53232/0x367645d450b3a008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a001 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.175865:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040d53232, rc 0) 00000100:00100000:2.0:1788526519.175920:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7aea801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881481856:12345-0@lo:101: Request processed in 123us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.175926:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788526519.176002:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000078a0916 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481856:0@lo:101: 00010000:00010000:3.0:1788526519.176027:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000076585aeb/0x367645d450b3a001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.176035:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000076585aeb/0x367645d450b3a001 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526519.176119:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481984:0@lo:501: 00000100:00100000:3.0:1788526519.176148:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.176384:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881481984 00000100:00100000:1.0:1788526519.176411:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881481984 00000100:00100000:1.0:1788526519.176444:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788526519.176449:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad95e2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881481984:12345-0@lo:501: 00000100:00100000:1.0:1788526519.176695:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad95e2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881481984:12345-0@lo:501: Request processed in 245us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.176703:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788526519.176981:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000801fd6a0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.176997:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881481984:0@lo:501: 00000100:00100000:3.0:1788526519.177028:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482112:0@lo:503: 00000100:00100000:3.0:1788526519.177069:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526519.177139:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000801fd6a0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.177220:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482112 00000100:00100000:2.0:1788526519.177225:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482112 00000100:00100000:2.0:1788526519.177345:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788526519.177353:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccf93d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482112:12345-0@lo:503: 00000100:00100000:2.0:1788526519.177732:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccf93d2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482112:12345-0@lo:503: Request processed in 379us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.177740:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788526519.177829:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000149637ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482112:0@lo:503: 00000040:00080000:0.0:1788526519.178193:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526519.178623:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067367a6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482240:0@lo:502: 00000100:00100000:0.0:1788526519.178685:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.178716:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000306d085a going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.180685:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482240 00000100:00100000:3.0:1788526519.180698:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482240 00000100:00100000:3.0:1788526519.180751:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788526519.180759:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006045454f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482240:12345-0@lo:502: 00000100:00100000:3.0:1788526519.181084:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006045454f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482240:12345-0@lo:502: Request processed in 325us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526519.181093:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788526519.181352:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067367a6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482240:0@lo:502: 00000040:00080000:0.0:1788526519.181673:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788526519.181733:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788526519.181782:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067367a6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482368:0@lo:502: 00000100:00100000:0.0:1788526519.181829:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.181865:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set 00000000306d085a going to sleep for 11 seconds 00000100:00100000:2.0:1788526519.182058:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482368 00000100:00100000:2.0:1788526519.182179:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482368 00000100:00100000:2.0:1788526519.182235:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788526519.182349:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003806729b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482368:12345-0@lo:502: 00000100:00100000:2.0:1788526519.182564:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003806729b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482368:12345-0@lo:502: Request processed in 219us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.182572:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788526519.182675:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067367a6f pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482368:0@lo:502: 00000040:00080000:0.0:1788526519.182884:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788526519.182906:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788526519.188481:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526519.188496:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526519.188499:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788526519.188505:0:6688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27453b800 00000020:00000080:2.0:1788526519.188508:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788526519.188544:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526519.188547:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526519.188548:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788526519.188551:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788526519.193024:0:6665:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788526519.193051:0:6665:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788526519.193074:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.193089:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526519.193155:0:6665:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788526519.193159:0:6665:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c27453b800 10000000:01000000:0.0:1788526519.193163:0:6665:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c27453b800 10000000:01000000:0.0:1788526519.193168:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788526519.193182:0:6665:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788526519.193285:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788526519.193295:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788526519.193308:0:6665:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c27453b800 from 1 10000000:01000000:0.0:1788526519.193311:0:6665:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788526519.193361:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.193369:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.193382:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.193424:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482496:0@lo:101: 00000100:00100000:0.0:1788526519.193497:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.193567:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24555eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.193640:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482496 00000100:00100000:3.0:1788526519.193650:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482496 00000100:00100000:3.0:1788526519.193710:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788526519.193720:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881482496:12345-0@lo:101: 00010000:00010000:3.0:1788526519.193734:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526519.193747:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a00f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.193784:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a00f expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.193795:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a00f expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526519.193803:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54600, rc 0) 00000100:00100000:3.0:1788526519.193859:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482496:12345-0@lo:101: Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526519.193866:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788526519.193969:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482496:0@lo:101: 00010000:00010000:2.0:1788526519.193984:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526519.193993:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526519.194062:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482624:0@lo:501: 00000100:00100000:2.0:1788526519.194089:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526519.194120:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526519.194497:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482624 00000100:00100000:0.0:1788526519.194501:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482624 00000100:00100000:0.0:1788526519.194527:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788526519.194534:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482624:12345-0@lo:501: 00000100:00100000:0.0:1788526519.194825:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482624:12345-0@lo:501: Request processed in 290us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526519.194832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788526519.198007:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482624:0@lo:501: 00000100:00100000:3.0:1788526519.198073:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482752:0@lo:503: 00000100:00100000:3.0:1788526519.198168:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526519.198211:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250fbe240 going to sleep for 11 seconds 00000100:00100000:0.0:1788526519.198312:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482752 00000100:00100000:0.0:1788526519.198320:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482752 00000100:00100000:0.0:1788526519.198375:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788526519.198404:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482752:12345-0@lo:503: 00000100:00100000:0.0:1788526519.200123:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482752:12345-0@lo:503: Request processed in 1733us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526519.200134:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788526519.200817:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482752:0@lo:503: 00000040:00080000:1.0:1788526519.201370:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526519.201470:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482880:0@lo:502: 00000100:00100000:1.0:1788526519.201534:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.201586:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788526519.202741:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881482880 00000100:00100000:0.0:1788526519.202751:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881482880 00000100:00100000:0.0:1788526519.202789:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788526519.202800:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482880:12345-0@lo:502: 00000100:00100000:0.0:1788526519.203062:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881482880:12345-0@lo:502: Request processed in 263us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526519.203070:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788526519.203107:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881482880:0@lo:502: 00000040:00080000:1.0:1788526519.203401:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788526519.203454:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788526519.203486:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788526519.203531:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788526519.206246:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788526519.206355:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788526519.206430:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788526519.206476:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788526519.207519:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788526519.208645:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788526519.208708:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788526519.208845:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788526519.208960:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788526519.209347:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788526519.209433:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788526519.209476:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788526519.209507:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788526519.209556:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788526519.209593:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788526519.209626:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788526519.209710:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788526519.210187:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788526519.210362:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788526519.210459:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788526519.210504:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788526519.210540:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788526519.210709:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788526519.210761:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788526519.210833:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881483008:0@lo:502: 00000100:00100000:0.0:1788526519.210932:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.210981:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24555eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.211047:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483008 00000100:00100000:3.0:1788526519.211055:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483008 00000100:00100000:3.0:1788526519.211114:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526519.211124:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881483008:12345-0@lo:502: 00000100:00100000:3.0:1788526519.211360:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881483008:12345-0@lo:502: Request processed in 237us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526519.211368:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788526519.211942:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881483008:0@lo:502: 00000040:00080000:1.0:1788526519.212523:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788526519.212538:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788526519.214951:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788526519.214972:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98c245b3b300) 00000020:00000080:3.0:1788526519.214995:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788526519.215095:0:6689:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c27453b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788526519.215099:0:6689:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c27453b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788526519.215108:0:6689:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c27453b800 3 00010000:00080000:3.0:1788526519.215142:0:6689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27fac8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1788526519.218602:0:6689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788526519.219093:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788526519.219137:0:6689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788526519.219159:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x367645d450b3a024 00000100:00080000:3.0:1788526519.219172:0:6689:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788526519.219179:0:6689:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c27fac8800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526519.219234:0:6689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c26f9da680 x1875405881483136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788526519.219264:0:6689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788526519.219442:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881483136:0@lo:38: 00000100:00100000:2.0:1788526519.219523:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526519.219623:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483136 00000100:00100000:2.0:1788526519.219632:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483136 00000100:00100000:2.0:1788526519.219680:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526519.219688:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1875405881483136:12345-0@lo:38: 00010000:00080000:2.0:1788526519.219718:0:5823:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1788526519.219773:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x367645d450b3a02b 00000004:00100000:2.0:1788526519.219794:0:5823:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788526519.219833:0:5823:0:(import.c:65:import_set_state_nolock()) ffff98c27fab2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526519.219904:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875405881483136:12345-0@lo:38: Request processed in 204us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.219913:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788526519.219986:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c26f9da680 x1875405881483136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526519.219999:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788526519.221368:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526519.221409:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881483264:0@lo:400: 00000100:00100000:1.0:1788526519.221462:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526519.221515:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483264 00000100:00100000:3.0:1788526519.221523:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483264 00000100:00100000:3.0:1788526519.221587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788526519.221597:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881483264:12345-0@lo:400: 00000100:00100000:3.0:1788526519.221654:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881483264:12345-0@lo:400: Request processed in 59us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526519.221660:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788526519.221703:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c2430a5500 x1875405881483264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526519.221720:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881483264:0@lo:400: 00000040:00080000:3.0:1788526519.223493:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:2.0:1788526519.224203:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788526519.224215:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788526519.224221:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788526519.224225:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27fac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788526519.224236:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881483136:0@lo:38: 00000020:01000000:0.0:1788526519.224771:0:6665:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788526519.224798:0:6665:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788526519.224823:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.224835:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788526519.224909:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788526519.224912:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788526519.224913:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788526519.224915:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788526519.224916:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788526519.224918:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788526519.224919:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788526519.224920:0:6665:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788526519.224922:0:6665:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788526519.224923:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788526519.224925:0:6665:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788526519.224929:0:6665:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788526519.224932:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788526519.224933:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788526519.224935:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788526519.224936:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788526519.224937:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788526519.224938:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788526519.224939:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788526519.224941:0:6665:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788526519.224942:0:6665:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788526519.224943:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788526519.224944:0:6665:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788526519.224969:0:6665:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788526519.224985:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881483392:0@lo:253: 00000100:00100000:0.0:1788526519.225054:0:6665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.225094:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24555ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526519.225279:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483392 00000100:00100000:3.0:1788526519.225287:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483392 00000100:00100000:3.0:1788526519.225338:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788526519.225348:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6665:x1875405881483392:12345-0@lo:253: 20000000:01000000:3.0:1788526519.225376:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788526519.225441:0:5817:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788526519.262298:0:5817:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788526519.262319:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788526519.262678:0:5838:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788526519.262685:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788526519.262726:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.262745:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39f98 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.262754:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.262797:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.262814:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.262831:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881483520:0@lo:104: 00000100:00100000:0.0:1788526519.262910:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526519.262976:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c272281840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526519.263040:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483520 00000100:00100000:1.0:1788526519.263048:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483520 00000100:00100000:1.0:1788526519.263097:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526519.263106:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881483520:12345-0@lo:104: 00010000:00010000:1.0:1788526519.263119:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263509:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788526519.263517:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881483520:12345-0@lo:104: Request processed in 412us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.263525:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788526519.263558:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526519.263565:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263573:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54c00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526519.263578:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263587:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526519.263609:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526519.263615:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788526519.263655:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263662:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526519.263682:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263690:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b54c00/0x367645d450b39f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39f9f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263709:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526519.263711:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526519.263712:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526519.263733:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881483648:0@lo:103: 00000100:00100000:1.0:1788526519.263765:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526519.263813:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483648 00000100:00100000:1.0:1788526519.263818:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483648 00010000:00010000:1.0:1788526519.263835:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 14 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526519.263857:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526519.263863:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:3280:x1875405881483648:12345-0@lo:103: 00010000:00010000:1.0:1788526519.263873:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526519.263878:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 14 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263906:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 14 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263924:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263933:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788526519.263946:0:5809:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002602471s 00010000:00010000:1.0:1788526519.263951:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263957:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263964:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263970:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263975:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526519.263980:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263987:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.263997:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526519.264017:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526519.264047:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:3280:x1875405881483648:12345-0@lo:103: Request processed in 184us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526519.264054:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526519.264095:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881483648:0@lo:103: 00010000:00010000:0.0:1788526519.264339:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54e00/0x367645d450b39f9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39f98 expref: 13 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526519.264351:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881483520:0@lo:104: 00010000:00010000:0.0:1788526519.264366:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.264374:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.264381:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526519.264494:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030400/0x367645d450b3a032 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526519.274844:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:6665:x1875405881483392:12345-0@lo:253: Request processed in 49485us (49777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526519.274860:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788526519.274974:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6665:1875405881483392:0@lo:253: 10000000:01000000:1.0:1788526519.274990:0:6665:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788526519.274994:0:6665:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788526519.274995:0:6665:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526519.274997:0:6665:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526519.274998:0:6665:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526519.274999:0:6665:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526519.275001:0:6665:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526519.275002:0:6665:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526519.275003:0:6665:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788526519.275005:0:6665:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788526519.275007:0:6665:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526519.275008:0:6665:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788526519.275022:0:6665:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788526519.290772:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788526519.290978:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788526519.291204:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788526519.291373:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788526519.291628:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788526519.296545:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788526519.298121:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788526519.521649:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788526519.636522:0:6665:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788526519.636594:0:6665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788526519.636632:0:6665:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788526519.636661:0:6665:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1788526520.147724:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788526520.147732:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c248515800 from 21 10000000:01000000:1.0:1788526520.147738:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526520.147804:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.147836:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.147848:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.147885:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881483776:0@lo:101: 00000100:00100000:1.0:1788526520.147957:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.148049:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27452cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.156922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483776 00000100:00100000:0.0:1788526520.156936:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483776 00000100:00100000:0.0:1788526520.156995:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788526520.157004:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5820:x1875405881483776:12345-0@lo:101: 00010000:00010000:0.0:1788526520.157020:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526520.157037:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a039 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.157064:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a039 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.157075:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a039 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.157084:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030000, rc 0) 00000100:00100000:0.0:1788526520.157162:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881483776:12345-0@lo:101: Request processed in 160us (9205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.157169:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788526520.162531:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881483776:0@lo:101: 00010000:00010000:1.0:1788526520.162566:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.162579:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.162648:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881483904:0@lo:501: 00000100:00100000:1.0:1788526520.162721:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.162780:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.162802:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881483904 00000100:00100000:1.0:1788526520.162808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881483904 00000100:00100000:1.0:1788526520.162856:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788526520.162866:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881483904:12345-0@lo:501: 00000100:00100000:1.0:1788526520.163140:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881483904:12345-0@lo:501: Request processed in 274us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.163149:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788526520.163195:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881483904:0@lo:501: 00000100:00100000:1.0:1788526520.163222:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484032:0@lo:503: 00000100:00100000:1.0:1788526520.163258:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.163274:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.163512:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484032 00000100:00100000:0.0:1788526520.163529:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484032 00000100:00100000:0.0:1788526520.163566:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788526520.163573:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881484032:12345-0@lo:503: 00000100:00100000:0.0:1788526520.163773:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881484032:12345-0@lo:503: Request processed in 200us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.163780:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788526520.163817:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484032:0@lo:503: 00000100:00100000:0.0:1788526520.164012:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6714:1875405881484160:0@lo:502: 00000100:00100000:0.0:1788526520.164047:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.164067:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484160 00000100:00100000:0.0:1788526520.164070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484160 00000100:00100000:0.0:1788526520.164088:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788526520.164094:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6714:x1875405881484160:12345-0@lo:502: 00000100:00100000:0.0:1788526520.164229:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6714:x1875405881484160:12345-0@lo:502: Request processed in 135us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.164236:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788526520.164261:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.164272:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6714:1875405881484160:0@lo:502: 00000100:00100000:0.0:1788526520.164309:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6714:1875405881484288:0@lo:502: 00000100:00100000:0.0:1788526520.164341:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.164359:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484288 00000100:00100000:0.0:1788526520.164362:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484288 00000100:00100000:0.0:1788526520.164378:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788526520.164408:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6714:x1875405881484288:12345-0@lo:502: 00000100:00100000:0.0:1788526520.164520:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:6714:x1875405881484288:12345-0@lo:502: Request processed in 135us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.164535:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788526520.164556:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.164566:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6714:1875405881484288:0@lo:502: 00000040:00080000:0.0:1788526520.164581:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788526520.164635:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788526520.164643:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788526520.164651:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164663:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526520.164673:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788526520.164676:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c248515800 from 4 10000000:01000000:0.0:1788526520.164680:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788526520.164704:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164712:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164720:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526520.164729:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484416:0@lo:101: 00000100:00100000:0.0:1788526520.164750:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.164761:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.164770:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484416 00000100:00100000:0.0:1788526520.164773:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484416 00000100:00100000:0.0:1788526520.164793:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788526520.164798:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881484416:12345-0@lo:101: 00010000:00010000:0.0:1788526520.164805:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526520.164816:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a047 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164833:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a047 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164842:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a047 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164850:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030c00, rc 0) 00000100:00100000:0.0:1788526520.164890:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881484416:12345-0@lo:101: Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.164896:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788526520.164921:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484416:0@lo:101: 00010000:00010000:0.0:1788526520.164930:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.164939:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526520.164975:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484544:0@lo:256: 00000100:00100000:0.0:1788526520.165005:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.165017:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.165027:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484544 00000100:00100000:0.0:1788526520.165030:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484544 00000100:00100000:0.0:1788526520.165045:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788526520.165057:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881484544:12345-0@lo:256: 20000000:01000000:0.0:1788526520.165069:0:5818:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788526520.165084:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788526520.165087:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788526520.165154:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881484544:12345-0@lo:256: Request processed in 97us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.165161:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788526520.165186:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484544:0@lo:256: 10000000:01000000:0.0:1788526520.165222:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788526520.165227:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165233:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526520.165239:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788526520.165241:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788526520.165243:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788526520.165257:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165264:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165270:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526520.165281:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484672:0@lo:101: 00000100:00100000:0.0:1788526520.165303:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.165323:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.165333:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484672 00000100:00100000:0.0:1788526520.165336:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484672 00000100:00100000:0.0:1788526520.165351:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788526520.165356:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881484672:12345-0@lo:101: 00010000:00010000:0.0:1788526520.165362:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526520.165369:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a055 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165382:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a055 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165414:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a055 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165421:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030400, rc 0) 00000100:00100000:0.0:1788526520.165448:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881484672:12345-0@lo:101: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.165454:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788526520.165479:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484672:0@lo:101: 00010000:00010000:0.0:1788526520.165489:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526520.165496:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526520.165520:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484800:0@lo:501: 00000100:00100000:0.0:1788526520.165542:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.165555:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.165570:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484800 00000100:00100000:0.0:1788526520.165574:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484800 00000100:00100000:0.0:1788526520.165590:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788526520.165595:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881484800:12345-0@lo:501: 00000100:00100000:0.0:1788526520.165805:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881484800:12345-0@lo:501: Request processed in 209us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.165812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788526520.165838:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484800:0@lo:501: 00000100:00100000:0.0:1788526520.165861:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484928:0@lo:503: 00000100:00100000:0.0:1788526520.165909:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.165922:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c260661b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.165934:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881484928 00000100:00100000:0.0:1788526520.165938:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881484928 00000100:00100000:0.0:1788526520.165954:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788526520.165960:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881484928:12345-0@lo:503: 00000100:00100000:0.0:1788526520.166152:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881484928:12345-0@lo:503: Request processed in 190us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.166159:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788526520.166191:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881484928:0@lo:503: 00000100:00100000:1.0:1788526520.183747:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6715:1875405881485056:0@lo:502: 00000100:00100000:1.0:1788526520.183840:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.183906:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526520.183975:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485056 00000100:00100000:3.0:1788526520.183982:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485056 00000100:00100000:3.0:1788526520.184023:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788526520.184032:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:6715:x1875405881485056:12345-0@lo:502: 00000100:00100000:3.0:1788526520.184336:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:6715:x1875405881485056:12345-0@lo:502: Request processed in 304us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526520.184344:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788526520.185742:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6715:1875405881485056:0@lo:502: 00000020:01000000:1.0:1788526520.185788:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788526520.185796:0:6715:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788526520.185804:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.185806:0:6715:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788526520.185814:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788526520.185818:0:6715:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1788526520.185847:0:6715:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788526520.185850:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788526520.185868:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98c249710000) 00000020:00000080:1.0:1788526520.185904:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788526520.185911:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788526520.186016:0:6715:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788526520.186022:0:6715:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788526520.186030:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3a06a 00010000:00080000:1.0:1788526520.186066:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27fa76800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1788526520.186293:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788526520.306783:0:6715:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788526520.306806:0:6715:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788526520.309250:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526520.309479:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526520.314283:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788526520.314409:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788526520.315812:0:6719:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788526520.315818:0:6719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788526520.321063:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788526520.321084:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788526520.321136:0:6715:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788526520.321160:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3a071 00000100:00080000:2.0:1788526520.321175:0:6715:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788526520.321180:0:6715:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c27fa76800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526520.321298:0:6715:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c249743b80 x1875405881485184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788526520.321327:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788526520.321418:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881485184:0@lo:8: 00000100:00100000:1.0:1788526520.321436:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881485312:0@lo:400: 00000100:00100000:1.0:1788526520.321507:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526520.321598:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526520.321637:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485312 00000100:00100000:1.0:1788526520.321637:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526520.321644:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485312 00000100:00100000:1.0:1788526520.321644:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881485440:0@lo:400: 00000100:00100000:1.0:1788526520.321681:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526520.321687:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485440 00000100:00100000:2.0:1788526520.321690:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485440 00000100:00100000:1.0:1788526520.321708:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485184 00000100:00100000:1.0:1788526520.321712:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485184 00000100:00100000:2.0:1788526520.321713:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526520.321721:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881485312:12345-0@lo:400: 00000100:00100000:1.0:1788526520.321730:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526520.321735:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875405881485184:12345-0@lo:8: 00010000:00080000:1.0:1788526520.321768:0:6669:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:1.0:1788526520.321794:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3a078 00002000:00100000:1.0:1788526520.321827:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98c27fa73800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788526520.321832:0:6669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788526520.321836:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788526520.321958:0:6669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788526520.322168:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788526520.322189:0:6669:0:(import.c:65:import_set_state_nolock()) ffff98c27fa70000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526520.322232:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875405881485184:12345-0@lo:8: Request processed in 496us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.322239:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526520.322262:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788526520.322269:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000000:1.0:1788526520.322325:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526520.322330:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.322333:0:6715:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788526520.322336:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526520.322340:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.322342:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788526520.322345:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788526520.322346:0:6715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788526520.322378:0:6715:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6715:1875405881485568:0@lo:502: 00000100:00100000:1.0:1788526520.322446:0:6715:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.322462:0:6715:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236180 going to sleep for 11 seconds 00000100:00100000:3.0:1788526520.322559:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788526520.322571:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526520.322581:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881485440:12345-0@lo:400: 00000100:00100000:3.0:1788526520.322628:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881485440:12345-0@lo:400: Request processed in 50us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526520.322635:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788526520.322653:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526520.322668:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485568 00000100:00100000:3.0:1788526520.322673:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485568 00000100:00100000:3.0:1788526520.322696:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788526520.322702:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:6715:x1875405881485568:12345-0@lo:502: 00000100:00100000:2.0:1788526520.322904:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881485312:12345-0@lo:400: Request processed in 1182us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526520.322912:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788526520.323084:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249743b80 x1875405881485184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788526530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526520.323095:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788526520.323103:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788526520.323111:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788526520.323117:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788526520.323120:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27fa76800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788526520.323132:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788526520.323138:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881485184:0@lo:8: 00010000:00080000:2.0:1788526520.323171:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249741180 x1875405881485312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526520.323179:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881485312:0@lo:400: 00000004:00080000:2.0:1788526520.323336:0:6719:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1788526520.323420:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249742680 x1875405881485440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526520.323430:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881485440:0@lo:400: 00000004:00080000:2.0:1788526520.323436:0:6719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 155664048643ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788526520.336792:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:6715:x1875405881485568:12345-0@lo:502: Request processed in 14079us (14334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526520.336808:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788526520.350963:0:6715:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6715:1875405881485568:0@lo:502: 00000020:01000000:1.0:1788526520.351595:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526520.351608:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.351611:0:6715:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788526520.351615:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788526520.351697:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788526520.351707:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788526520.351718:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.351731:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526520.351835:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788526520.351837:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c248515800 from 1 10000000:01000000:1.0:1788526520.351840:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788526520.351884:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.351893:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.351902:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.351929:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485696:0@lo:101: 00000100:00100000:1.0:1788526520.352003:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.352046:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236180 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.352070:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485696 00000100:00100000:1.0:1788526520.352077:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485696 00000100:00100000:1.0:1788526520.352120:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788526520.352128:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881485696:12345-0@lo:101: 00010000:00010000:1.0:1788526520.352142:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526520.352154:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a07f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.352177:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a07f expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.352204:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a07f expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.352213:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241663e00, rc 0) 00000100:00100000:1.0:1788526520.352245:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881485696:12345-0@lo:101: Request processed in 117us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.352251:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788526520.352361:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485696:0@lo:101: 00010000:00010000:1.0:1788526520.352374:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.352382:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.352440:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485824:0@lo:501: 00000100:00100000:1.0:1788526520.352465:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.352480:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236180 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.352492:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485824 00000100:00100000:1.0:1788526520.352495:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485824 00000100:00100000:1.0:1788526520.352639:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788526520.352647:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881485824:12345-0@lo:501: 00000100:00100000:1.0:1788526520.353895:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881485824:12345-0@lo:501: Request processed in 1244us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.353905:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788526520.353967:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485824:0@lo:501: 00000100:00100000:1.0:1788526520.354315:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485952:0@lo:503: 00000100:00100000:1.0:1788526520.354369:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.354412:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236180 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.354433:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881485952 00000100:00100000:1.0:1788526520.354438:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881485952 00000100:00100000:1.0:1788526520.354474:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788526520.354483:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881485952:12345-0@lo:503: 00000100:00100000:1.0:1788526520.356268:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881485952:12345-0@lo:503: Request processed in 1779us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.356280:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788526520.356361:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881485952:0@lo:503: 00000100:00100000:1.0:1788526520.360241:0:6723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6723:1875405881486080:0@lo:502: 00000100:00100000:1.0:1788526520.360327:0:6723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.360384:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486080 00000100:00100000:1.0:1788526520.360405:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486080 00000100:00100000:1.0:1788526520.360448:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788526520.360456:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:6723:x1875405881486080:12345-0@lo:502: 00000100:00100000:1.0:1788526520.360705:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:6723:x1875405881486080:12345-0@lo:502: Request processed in 249us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.360713:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788526520.361142:0:6723:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.361165:0:6723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6723:1875405881486080:0@lo:502: 00000020:01000000:1.0:1788526520.361195:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526520.361204:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.361207:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788526520.361213:0:6723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c248515800 00000020:00000080:1.0:1788526520.361215:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788526520.361237:0:6723:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6723:1875405881486208:0@lo:502: 00000100:00100000:1.0:1788526520.361271:0:6723:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.361294:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486208 00000100:00100000:1.0:1788526520.361299:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486208 00000100:00100000:1.0:1788526520.361322:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526520.361328:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:6723:x1875405881486208:12345-0@lo:502: 00000100:00100000:1.0:1788526520.361457:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:6723:x1875405881486208:12345-0@lo:502: Request processed in 128us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.361463:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526520.361491:0:6723:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.361502:0:6723:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:6723:1875405881486208:0@lo:502: 00000020:01000000:1.0:1788526520.361580:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526520.361585:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526520.361586:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788526520.361596:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788526520.361646:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788526520.361655:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526520.361665:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.361675:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526520.361684:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788526520.361686:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c248515800 from 1 10000000:01000000:1.0:1788526520.361689:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788526520.361712:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.361720:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.361728:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.362118:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881486336:0@lo:101: 00000100:00100000:1.0:1788526520.362156:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.362175:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.362189:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486336 00000100:00100000:1.0:1788526520.362193:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486336 00000100:00100000:1.0:1788526520.362218:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788526520.362226:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881486336:12345-0@lo:101: 00010000:00010000:1.0:1788526520.362234:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526520.362247:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a08d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.362275:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.362286:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.362295:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241662400, rc 0) 00000100:00100000:1.0:1788526520.362326:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881486336:12345-0@lo:101: Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526520.362332:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788526520.362365:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881486336:0@lo:101: 00010000:00010000:1.0:1788526520.362379:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.362406:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526520.362437:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881486464:0@lo:501: 00000100:00100000:1.0:1788526520.362461:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.362475:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.362486:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486464 00000100:00100000:1.0:1788526520.362489:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486464 00000100:00100000:1.0:1788526520.362510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788526520.363606:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881486464:12345-0@lo:501: 00000100:00100000:1.0:1788526520.364187:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881486464:12345-0@lo:501: Request processed in 1669us (1722us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526520.364195:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788526520.364255:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881486464:0@lo:501: 10000000:01000000:1.0:1788526520.364275:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788526520.364284:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526520.364294:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788526520.418713:0:6720:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788526520.418750:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486720:0@lo:7: 00000100:00100000:1.0:1788526520.418835:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.418905:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b768240 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.418924:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881486592:0@lo:13: 00000100:00100000:1.0:1788526520.418950:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788526520.419084:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788526520.419138:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486720 00000100:00100000:1.0:1788526520.419147:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486720 00000100:00100000:1.0:1788526520.419306:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526520.419317:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875405881486720:12345-0@lo:7: 00000100:00100000:0.0:1788526520.423661:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486592 00000100:00100000:0.0:1788526520.423679:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486592 00000100:00100000:0.0:1788526520.423735:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526520.423756:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875405881486592:12345-0@lo:13: 00002000:00000024:0.0:1788526520.423784:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1788526520.423866:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875405881486592:12345-0@lo:13: Request processed in 111us (4914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.423887:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788526520.423945:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249743800 x1875405881486592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526520.423966:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881486592:0@lo:13: 00000100:00080000:2.0:1788526520.425336:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788526520.438657:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788526520.438668:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788526520.438776:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875405881486720:12345-0@lo:7: Request processed in 19455us (19935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.438793:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788526520.438916:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249742680 x1875405881486720/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788526536 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526520.438933:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486720:0@lo:7: 00000004:00080000:1.0:1788526520.438948:0:6720:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788526520.439001:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486848:0@lo:5: 00000100:00100000:1.0:1788526520.439038:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.439088:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526520.439153:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486848 00000100:00100000:3.0:1788526520.439160:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486848 00000100:00100000:3.0:1788526520.439206:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526520.439217:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6720:x1875405881486848:12345-0@lo:5: 00002000:00080000:3.0:1788526520.439243:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788526520.439248:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788526520.439592:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6720:x1875405881486848:12345-0@lo:5: Request processed in 376us (553us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788526520.439600:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788526520.439882:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249742680 x1875405881486848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788526536 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526520.439896:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486848:0@lo:5: 00000004:00080000:0.0:1788526520.439907:0:6720:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788526520.439936:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486976:0@lo:700: 00000100:00100000:0.0:1788526520.439969:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.439998:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24555b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788526520.440100:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881486976 00000100:00100000:1.0:1788526520.440116:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881486976 00000100:00100000:1.0:1788526520.440160:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526520.440167:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6720:x1875405881486976:12345-0@lo:700: 00000100:00100000:1.0:1788526520.440199:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1875405881487104:0@lo:700: 00000100:00100000:1.0:1788526520.440229:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526520.440244:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526520.440481:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487104 00000100:00100000:0.0:1788526520.440485:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487104 00000100:00100000:0.0:1788526520.440613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526520.440623:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1875405881487104:12345-0@lo:700: 40000000:02000000:1.0:1788526520.472171:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788526520.486334:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6677:x1875405881487104:12345-0@lo:700: Request processed in 45699us (46090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526520.486368:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788526520.486669:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249741880 x1875405881487104/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788526536 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526520.486684:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6677:1875405881487104:0@lo:700: 40000000:02000000:3.0:1788526520.486700:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1788526520.531824:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788526520.632415:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788526520.632440:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788526520.632763:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6720:x1875405881486976:12345-0@lo:700: Request processed in 192589us (192786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526520.632785:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788526520.632892:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4700 x1875405881486976/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788526536 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526520.632905:0:6720:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788526520.632923:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881486976:0@lo:700: 00000004:02000040:0.0:1788526520.665301:0:6720:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788526520.686163:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881487232:0@lo:5: 00000100:00100000:0.0:1788526520.686236:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526520.686286:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487232 00000100:00100000:0.0:1788526520.686295:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487232 00000100:00100000:0.0:1788526520.686358:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788526520.686367:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6720:x1875405881487232:12345-0@lo:5: 00000100:00100000:1.0:1788526520.692698:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b66db40 going to sleep for 11 seconds 00002000:00080000:1.0:1788526520.727888:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788526520.727927:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788526520.741612:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875405881487232:12345-0@lo:5: Request processed in 55237us (55366us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788526520.741627:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788526520.741699:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4700 x1875405881487232/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788526536 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526520.741717:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875405881487232:0@lo:5: 00000004:00080000:1.0:1788526520.741732:0:6720:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788526521.556770:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526522.580319:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526523.603878:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526524.627707:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526525.396234:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881487744:0@lo:400: 00000100:00100000:0.0:1788526525.396339:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526525.396431:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788526525.396438:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881487616:0@lo:400: 00000100:00100000:0.0:1788526525.396471:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526525.396509:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487616 00000100:00100000:0.0:1788526525.396518:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487616 00000100:00100000:0.0:1788526525.396587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526525.396768:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881487488:0@lo:400: 00000100:00100000:2.0:1788526525.396814:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526525.396835:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526525.396841:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881487360:0@lo:400: 00000100:00100000:2.0:1788526525.396869:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788526525.396899:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526525.396911:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487488 00000100:00100000:2.0:1788526525.396914:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487488 00000100:00100000:2.0:1788526525.396950:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526525.396958:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881487488:12345-0@lo:400: 00000100:00100000:2.0:1788526525.397008:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881487488:12345-0@lo:400: Request processed in 51us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526525.397016:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788526525.397063:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4a80 x1875405881487488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526525.397079:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881487488:0@lo:400: 00000100:00100000:0.0:1788526525.397256:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881487616:12345-0@lo:400: 00000100:00100000:0.0:1788526525.397321:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881487616:12345-0@lo:400: Request processed in 726us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526525.397329:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788526525.397482:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4e00 x1875405881487616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526525.397519:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881487616:0@lo:400: 00000100:00100000:1.0:1788526525.398071:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487744 00000100:00100000:1.0:1788526525.398080:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487744 00000100:00080000:2.0:1788526525.398198:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526525.398256:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526525.398266:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875405881487744:12345-0@lo:400: 00000100:00100000:1.0:1788526525.398729:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875405881487744:12345-0@lo:400: Request processed in 465us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526525.398747:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526525.398783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487360 00000100:00100000:1.0:1788526525.398787:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487360 00000100:00100000:1.0:1788526525.398819:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788526525.398826:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3281:x1875405881487360:12345-0@lo:400: 00000100:00100000:1.0:1788526525.398871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3281:x1875405881487360:12345-0@lo:400: Request processed in 46us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526525.398877:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788526525.398921:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881487360:0@lo:400: 00010000:00080000:2.0:1788526525.410514:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a7480 x1875405881487744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526525.410535:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881487744:0@lo:400: 00010000:00010000:3.0:1788526525.651685:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526525.907893:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881487872:0@lo:13: 00000100:00100000:1.0:1788526525.907979:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526525.908080:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881487872 00000100:00100000:1.0:1788526525.908088:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881487872 00000100:00100000:1.0:1788526525.908140:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526525.908149:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875405881487872:12345-0@lo:13: 00002000:00000024:1.0:1788526525.908191:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526525.908239:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875405881487872:12345-0@lo:13: Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526525.908246:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788526525.908289:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249742300 x1875405881487872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526525.908309:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881487872:0@lo:13: 00000001:00080000:1.0:1788526526.019425:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788526526.676362:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788526527.477512:0:7040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788526527.699837:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526528.726746:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526529.749484:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526530.515692:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881488000:0@lo:400: 00000100:00100000:0.0:1788526530.515703:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881488256:0@lo:400: 00000100:00100000:3.0:1788526530.515805:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881488128:0@lo:400: 00000100:00100000:2.0:1788526530.515859:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881488384:0@lo:400: 00000100:00100000:0.0:1788526530.517455:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526530.517568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488256 00000100:00100000:0.0:1788526530.517576:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488256 00000100:00100000:0.0:1788526530.517639:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788526530.517648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881488256:12345-0@lo:400: 00000100:00100000:0.0:1788526530.517734:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881488256:12345-0@lo:400: Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526530.517741:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788526530.517798:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4e00 x1875405881488256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526530.517812:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881488256:0@lo:400: 00000100:00080000:0.0:1788526530.517855:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526530.519503:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526530.519882:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488128 00000100:00100000:0.0:1788526530.519891:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488128 00000100:00100000:0.0:1788526530.519956:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788526530.519967:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881488128:12345-0@lo:400: 00000100:00100000:0.0:1788526530.520025:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881488128:12345-0@lo:400: Request processed in 61us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526530.520032:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788526530.520105:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788526530.520425:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a6d80 x1875405881488128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526530.520442:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881488128:0@lo:400: 00000100:00100000:0.0:1788526530.520865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488000 00000100:00100000:0.0:1788526530.520872:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488000 00000100:00100000:0.0:1788526530.520913:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788526530.520922:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3281:x1875405881488000:12345-0@lo:400: 00000100:00100000:0.0:1788526530.520992:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3281:x1875405881488000:12345-0@lo:400: Request processed in 72us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526530.521001:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788526530.521354:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526530.522087:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881488000:0@lo:400: 00000100:00100000:0.0:1788526530.522423:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488384 00000100:00100000:0.0:1788526530.522431:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488384 00000100:00100000:0.0:1788526530.522541:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788526530.522550:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881488384:12345-0@lo:400: 00000100:00100000:0.0:1788526530.522637:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881488384:12345-0@lo:400: Request processed in 88us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526530.522645:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788526530.522709:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788526530.522750:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4a80 x1875405881488384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526530.522762:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788526530.522776:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881488384:0@lo:400: 00010000:00010000:1.0:1788526530.781552:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526531.032425:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881488512:0@lo:13: 00000100:00100000:1.0:1788526531.032529:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526531.032631:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488512 00000100:00100000:1.0:1788526531.032643:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488512 00000100:00100000:1.0:1788526531.032715:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526531.032726:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881488512:12345-0@lo:13: 00002000:00000024:1.0:1788526531.032773:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526531.032842:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881488512:12345-0@lo:13: Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526531.032849:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788526531.033466:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c249742300 x1875405881488512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526531.033491:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881488512:0@lo:13: 00010000:00010000:0.0:1788526531.798505:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526532.821282:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526533.844807:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526534.867730:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526535.638135:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881488896:0@lo:400: 00000100:00100000:2.0:1788526535.638212:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526535.638288:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526535.638296:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881489024:0@lo:400: 00000100:00100000:2.0:1788526535.638323:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526535.638375:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489024 00000100:00100000:2.0:1788526535.638383:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489024 00000100:00100000:2.0:1788526535.638466:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526535.638477:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881489024:12345-0@lo:400: 00000100:00100000:2.0:1788526535.638530:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881489024:12345-0@lo:400: Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526535.638537:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788526535.638592:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788526535.638794:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e47480 x1875405881489024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526535.638810:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881489024:0@lo:400: 00000100:00100000:0.0:1788526535.639325:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881488640:0@lo:400: 00000100:00100000:0.0:1788526535.639371:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526535.639439:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526535.639447:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881488768:0@lo:400: 00000100:00100000:0.0:1788526535.639475:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526535.639508:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488896 00000100:00100000:0.0:1788526535.639514:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488896 00000100:00100000:0.0:1788526535.639554:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488768 00000100:00100000:0.0:1788526535.639585:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488768 00000100:00100000:0.0:1788526535.639622:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788526535.639630:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881488896:12345-0@lo:400: 00000100:00100000:0.0:1788526535.639674:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881488896:12345-0@lo:400: Request processed in 46us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526535.639682:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788526535.639835:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788526535.639843:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881488768:12345-0@lo:400: 00000100:00100000:0.0:1788526535.639877:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881488768:12345-0@lo:400: Request processed in 35us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526535.639884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788526535.639910:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526535.639943:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e44a80 x1875405881488768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526535.639955:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881488768:0@lo:400: 00010000:00080000:0.0:1788526535.639980:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e44e00 x1875405881488896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526535.639989:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881488896:0@lo:400: 00000100:00100000:2.0:1788526535.640284:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881488640 00000100:00100000:2.0:1788526535.640290:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881488640 00000100:00100000:2.0:1788526535.640323:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788526535.640331:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3278:x1875405881488640:12345-0@lo:400: 00000100:00100000:2.0:1788526535.640371:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3278:x1875405881488640:12345-0@lo:400: Request processed in 42us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526535.640378:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788526535.640797:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881488640:0@lo:400: 00010000:00010000:3.0:1788526535.895323:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526536.161123:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526536.161157:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881489152:0@lo:13: 00000100:00100000:2.0:1788526536.161253:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526536.161337:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489152 00000100:00100000:2.0:1788526536.161347:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489152 00000100:00100000:2.0:1788526536.161426:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526536.161437:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881489152:12345-0@lo:13: 00002000:00000024:2.0:1788526536.161474:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526536.161525:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881489152:12345-0@lo:13: Request processed in 90us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526536.161786:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788526536.161838:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e47480 x1875405881489152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526536.161858:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881489152:0@lo:13: 00010000:00010000:1.0:1788526536.916825:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526537.940764:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526538.963685:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526539.993479:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526540.755627:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881489664:0@lo:400: 00000100:00100000:2.0:1788526540.755704:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526540.755765:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526540.755771:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881489280:0@lo:400: 00000100:00100000:2.0:1788526540.755802:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526540.755833:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881489408:0@lo:400: 00000100:00100000:2.0:1788526540.755871:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526540.755889:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526540.755893:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881489536:0@lo:400: 00000100:00100000:2.0:1788526540.755911:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526540.755938:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489664 00000100:00100000:2.0:1788526540.755945:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489664 00000100:00100000:2.0:1788526540.756014:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526540.756024:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881489664:12345-0@lo:400: 00000100:00100000:2.0:1788526540.756071:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881489664:12345-0@lo:400: Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526540.756078:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526540.756109:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489280 00000100:00100000:2.0:1788526540.756113:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489280 00000100:00100000:2.0:1788526540.756135:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788526540.756142:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3278:x1875405881489280:12345-0@lo:400: 00000100:00100000:2.0:1788526540.756536:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3278:x1875405881489280:12345-0@lo:400: Request processed in 393us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526540.756544:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788526540.756576:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489408 00000100:00100000:2.0:1788526540.756580:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489408 00000100:00100000:2.0:1788526540.756606:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489536 00000100:00100000:2.0:1788526540.756627:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489536 00000100:00100000:2.0:1788526540.756656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526540.756662:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881489408:12345-0@lo:400: 00000100:00100000:2.0:1788526540.756700:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881489408:12345-0@lo:400: Request processed in 39us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526540.756706:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526540.756717:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526540.756722:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881489536:12345-0@lo:400: 00000100:00100000:2.0:1788526540.756765:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881489536:12345-0@lo:400: Request processed in 43us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526540.756771:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788526540.756791:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526540.756795:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788526540.756836:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e45180 x1875405881489536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526540.757342:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881489536:0@lo:400: 00010000:00080000:2.0:1788526540.757360:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e45f80 x1875405881489408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526540.757368:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881489408:0@lo:400: 00000100:00100000:2.0:1788526540.758060:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881489280:0@lo:400: 00010000:00080000:2.0:1788526540.758076:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c281e46680 x1875405881489664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526540.758086:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881489664:0@lo:400: 00010000:00010000:0.0:1788526541.011525:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526541.268929:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526541.268958:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881489792:0@lo:13: 00000100:00100000:3.0:1788526541.269083:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526541.269175:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489792 00000100:00100000:3.0:1788526541.269249:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489792 00000100:00100000:3.0:1788526541.269306:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526541.269419:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881489792:12345-0@lo:13: 00002000:00000024:3.0:1788526541.269478:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526541.269532:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881489792:12345-0@lo:13: Request processed in 117us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526541.269539:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788526541.269589:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c26f9d8a80 x1875405881489792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526541.269611:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881489792:0@lo:13: 00010000:00010000:2.0:1788526542.041818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526543.060756:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788526543.415368:0:7611:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788526543.415372:0:7611:0:(obd_mount.c:928:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788526543.415617:0:7611:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c274ba0000 00000020:01000004:1.0:1788526543.415635:0:7611:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788526543.415647:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788526543.415660:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98c249714c80) 00000020:00000080:1.0:1788526543.415674:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788526543.432792:0:7611:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788526543.433237:0:7611:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788526543.471872:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788526543.486007:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788526543.486074:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788526543.486183:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788526543.486236:0:7611:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788526543.487033:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788526543.487044:0:7611:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788526543.487055:0:7611:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x367645d450b3a0a2 00000020:01000004:1.0:1788526543.487193:0:7611:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788526543.487277:0:7611:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788526543.487281:0:7611:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788526543.487288:0:7611:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788526543.487318:0:7611:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788526543.487322:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788526543.487323:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788526543.487325:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526543.487326:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526543.487328:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526543.487329:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526543.487331:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526543.487332:0:7611:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788526543.487333:0:7611:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788526543.487335:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526543.487336:0:7611:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526543.487339:0:7611:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788526543.487341:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788526543.487342:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788526543.487343:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526543.487344:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526543.487346:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526543.487347:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526543.487348:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526543.487349:0:7611:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788526543.487350:0:7611:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788526543.487351:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526543.487352:0:7611:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526543.487416:0:7611:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788526543.487448:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881489920:0@lo:253: 00000100:00100000:1.0:1788526543.487598:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526543.487749:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526543.488689:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881489920 00000100:00100000:0.0:1788526543.488701:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881489920 00000100:00100000:0.0:1788526543.488862:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788526543.488873:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:7611:x1875405881489920:12345-0@lo:253: 20000000:01000000:0.0:1788526543.488930:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788526543.488934:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788526543.488940:0:5818:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788526543.488943:0:5818:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788526543.490080:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526543.490320:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788526543.490334:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788526543.490375:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788526543.490383:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788526543.490463:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788526543.490511:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788526543.490903:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788526543.490933:0:5818:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:0.0:1788526543.490936:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1788526543.490975:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788526543.490983:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788526543.491033:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788526543.491042:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1788526543.491075:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788526543.491086:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788526543.491120:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788526543.491167:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788526543.494516:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788526543.494672:0:5818:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:3.0:1788526543.494675:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1788526543.494719:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788526543.494727:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788526543.494833:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788526543.494858:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1788526543.494899:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788526543.494915:0:5818:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788526543.495443:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788526543.495497:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788526543.495630:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788526543.495636:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788526543.495644:0:5818:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788526543.495646:0:5818:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788526543.495649:0:5818:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788526543.495667:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788526543.495675:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788526543.495731:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788526543.495734:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788526543.499027:0:7613:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788526543.499216:0:7613:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788526543.499249:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788526543.500029:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788526543.500615:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788526543.500686:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788526543.500718:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788526543.500720:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788526543.502519:0:7614:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788526543.502855:0:7614:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788526543.502927:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788526543.503508:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788526543.503686:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788526543.503744:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788526543.503833:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788526543.503836:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788526543.506511:0:7615:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788526543.507156:0:7615:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788526543.507243:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788526543.507888:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788526543.508204:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788526543.508311:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788526543.508327:0:5818:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788526543.508329:0:5818:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788526543.509343:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788526543.510851:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788526543.510918:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788526543.511142:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1788526543.511165:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788526543.511189:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511212:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39fc9 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511220:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b39fe5 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511228:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a00f expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511235:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a039 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511242:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a055 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511248:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511276:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511326:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.511346:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.511362:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490048:0@lo:104: 00000100:00100000:3.0:1788526543.512127:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788526543.512223:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.512234:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 17 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.512245:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490176:0@lo:104: 00010000:00010000:3.0:1788526543.512268:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.512276:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 17 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.512283:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9dad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490304:0@lo:104: 00010000:00010000:3.0:1788526543.512298:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.512305:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 17 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.512322:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490432:0@lo:104: 00010000:00010000:3.0:1788526543.512344:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.512352:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 17 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.512360:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490560:0@lo:104: 00010000:00010000:3.0:1788526543.512379:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.512411:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 17 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.512445:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490688:0@lo:104: 00000100:00100000:3.0:1788526543.512462:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c26e4f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788526543.513028:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788526543.513057:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513077:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513085:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513092:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513100:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513112:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490048 00000100:00100000:2.0:1788526543.513119:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490048 00000100:00100000:2.0:1788526543.513159:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490176 00000100:00100000:2.0:1788526543.513162:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490176 00000100:00100000:2.0:1788526543.513172:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490304 00000100:00100000:2.0:1788526543.513174:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490304 00000100:00100000:2.0:1788526543.513182:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490432 00000100:00100000:2.0:1788526543.513184:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490432 00000100:00100000:0.0:1788526543.513185:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490560 00000100:00100000:0.0:1788526543.513189:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490560 00000100:00100000:2.0:1788526543.513191:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490688 00000100:00100000:2.0:1788526543.513193:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490688 00000100:00100000:2.0:1788526543.513204:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526543.513212:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249350450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:5818:x1875405881490048:12345-0@lo:104: 00010000:00010000:2.0:1788526543.513224:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.513351:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526543.513359:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249350450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:5818:x1875405881490048:12345-0@lo:104: Request processed in 147us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513366:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788526543.513377:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526543.513384:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513415:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:0.0:1788526543.513428:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.513435:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788526543.513437:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.513441:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:5818:x1875405881490176:12345-0@lo:104: 10000000:00010000:0.0:1788526543.513446:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526543.513452:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526543.513458:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513481:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513487:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526543.513503:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526543.513508:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:5818:x1875405881490176:12345-0@lo:104: Request processed in 68us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513514:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526543.513526:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526543.513532:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5818:x1875405881490304:12345-0@lo:104: 00010000:00010000:2.0:1788526543.513549:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.513575:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788526543.513579:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:5818:x1875405881490304:12345-0@lo:104: Request processed in 48us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513585:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526543.513596:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788526543.513601:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:5818:x1875405881490432:12345-0@lo:104: 00010000:00010000:2.0:1788526543.513608:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.513632:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788526543.513636:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:5818:x1875405881490432:12345-0@lo:104: Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513642:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788526543.513653:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526543.513659:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:5818:x1875405881490688:12345-0@lo:104: 00010000:00010000:2.0:1788526543.513672:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.513698:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788526543.513703:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:5818:x1875405881490688:12345-0@lo:104: Request processed in 45us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513709:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526543.513722:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526543.513728:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881490560:12345-0@lo:104: 00010000:00010000:2.0:1788526543.513736:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.513759:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788526543.513764:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5818:x1875405881490560:12345-0@lo:104: Request processed in 36us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.513769:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788526543.513791:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788526543.513837:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513845:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a094 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513858:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788526543.513861:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513867:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663c00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:0.0:1788526543.513869:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.513875:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526543.513881:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526543.513886:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788526543.513904:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881490816:0@lo:103: 00000100:00100000:2.0:1788526543.513936:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.513984:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490816 00000100:00100000:2.0:1788526543.513989:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490816 00010000:00010000:2.0:1788526543.514007:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514030:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526543.514037:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2493a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3280:x1875405881490816:12345-0@lo:103: 00010000:00010000:2.0:1788526543.514046:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.514057:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514067:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514083:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.514111:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2493a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3280:x1875405881490816:12345-0@lo:103: Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.514117:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526543.514200:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881490816:0@lo:103: 00010000:00010000:2.0:1788526543.514257:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788526543.514262:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514267:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526543.514270:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514276:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526543.514282:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.514286:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526543.514300:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514306:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526543.514319:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514326:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240031600/0x367645d450b3a055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a05c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514353:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526543.514356:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514362:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240031400 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526543.514364:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514370:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526543.514376:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.514380:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526543.514438:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514444:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526543.514464:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514470:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240031400/0x367645d450b39fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fd0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514479:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526543.514486:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514492:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526543.514494:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514500:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526543.514506:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.514511:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526543.514523:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514528:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526543.514534:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514539:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b39fe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b39fec expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514547:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.514549:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.514551:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526543.514563:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881490944:0@lo:103: 00000100:00100000:2.0:1788526543.514588:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.514618:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881491200:0@lo:103: 00000100:00100000:2.0:1788526543.514649:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.514666:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788526543.514669:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514672:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881491072:0@lo:103: 00010000:00010000:0.0:1788526543.514676:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788526543.514687:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514691:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526543.514694:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a040 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.514704:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526543.514711:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526543.514712:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881490944 00010000:00010000:0.0:1788526543.514713:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526543.514715:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881490944 00010000:00010000:2.0:1788526543.514731:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514745:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491200 00000100:00100000:2.0:1788526543.514747:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491200 00010000:00010000:2.0:1788526543.514757:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 19 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514766:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491072 00000100:00100000:2.0:1788526543.514768:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491072 00010000:00010000:2.0:1788526543.514777:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 20 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.514787:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526543.514792:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3281:x1875405881490944:12345-0@lo:103: 00010000:00010000:2.0:1788526543.514800:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.514804:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 20 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514812:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 20 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514824:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.514845:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3281:x1875405881490944:12345-0@lo:103: Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.514859:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526543.514872:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526543.514878:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3279:x1875405881491200:12345-0@lo:103: 00010000:00010000:2.0:1788526543.514884:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.514888:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 19 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514897:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 19 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514906:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.514938:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3279:x1875405881491200:12345-0@lo:103: Request processed in 60us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.514944:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526543.514954:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788526543.514959:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3279:x1875405881491072:12345-0@lo:103: 00010000:00010000:2.0:1788526543.514966:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.514970:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 18 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514977:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 18 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.514986:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.515005:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3279:x1875405881491072:12345-0@lo:103: Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.515011:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788526543.515033:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881491328:0@lo:103: 00000100:00100000:2.0:1788526543.515060:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.515097:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881490944:0@lo:103: 00000100:00100000:2.0:1788526543.515113:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491328 00000100:00100000:2.0:1788526543.515116:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491328 00010000:00010000:2.0:1788526543.515129:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.515146:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526543.515151:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3280:x1875405881491328:12345-0@lo:103: 00010000:00010000:2.0:1788526543.515158:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.515162:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515169:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515177:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.515201:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3280:x1875405881491328:12345-0@lo:103: Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.515205:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526543.515227:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881491328:0@lo:103: 00010000:00010000:2.0:1788526543.515349:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.515354:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515361:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526543.515364:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515381:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526543.515409:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.515414:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526543.515455:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515461:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526543.515471:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515478:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030e00/0x367645d450b3a00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a016 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.515497:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881491456:0@lo:103: 00000100:00100000:2.0:1788526543.515520:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.515547:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491456 00000100:00100000:2.0:1788526543.515550:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491456 00010000:00010000:2.0:1788526543.515563:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.515581:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526543.515586:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3281:x1875405881491456:12345-0@lo:103: 00010000:00010000:2.0:1788526543.515593:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526543.515597:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515612:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 18 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515626:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515636:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515649:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515657:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515664:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515669:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515674:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526543.515678:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515685:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515692:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.515711:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526543.515737:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3281:x1875405881491456:12345-0@lo:103: Request processed in 151us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.515743:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526543.515767:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881491456:0@lo:103: 00010000:00010000:2.0:1788526543.515779:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.515781:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.515783:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.515786:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526543.515787:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526543.516335:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881491072:0@lo:103: 00000100:00100000:0.0:1788526543.516345:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881491200:0@lo:103: 00010000:00010000:3.0:1788526543.516682:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241662400/0x367645d450b3a094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a08d expref: 17 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516698:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490048:0@lo:104: 00010000:00010000:3.0:1788526543.516714:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030400/0x367645d450b3a05c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a055 expref: 16 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516721:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490176:0@lo:104: 00010000:00010000:3.0:1788526543.516732:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030000/0x367645d450b3a040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a039 expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516760:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9dad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490304:0@lo:104: 00010000:00010000:3.0:1788526543.516774:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54600/0x367645d450b3a016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a00f expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516783:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490432:0@lo:104: 00010000:00010000:3.0:1788526543.516793:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044600/0x367645d450b39fec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39fe5 expref: 13 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516801:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490560:0@lo:104: 00010000:00010000:3.0:1788526543.516811:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045800/0x367645d450b39fd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b39fc9 expref: 12 pid: 5815 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.516820:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5818:1875405881490688:0@lo:104: 00010000:00010000:3.0:1788526543.516847:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.516857:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.516863:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.516869:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55a00/0x367645d450b3a0a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788526543.516887:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788526543.594885:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:7611:x1875405881489920:12345-0@lo:253: Request processed in 106003us (107277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526543.594900:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788526543.595197:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881489920:0@lo:253: 10000000:01000000:1.0:1788526543.595213:0:7611:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788526543.595217:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788526543.595218:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788526543.595220:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526543.595221:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788526543.595222:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526543.595224:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526543.595225:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526543.595227:0:7611:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788526543.595228:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526543.595230:0:7611:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788526543.595251:0:7611:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c274ba0000 from lustre-OST0001 10000000:01000000:1.0:1788526543.595280:0:7611:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788526543.595283:0:7611:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788526543.595289:0:7611:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c274ba0000 10000000:01000000:1.0:1788526543.595295:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526543.595312:0:7611:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788526543.622281:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788526543.647906:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788526543.647937:0:7611:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c274ba0000 from 1 10000000:01000000:3.0:1788526543.647942:0:7611:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788526543.648321:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.648336:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.648349:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.648894:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491584:0@lo:101: 00000100:00100000:3.0:1788526543.649188:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526543.649318:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c26e4f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788526543.649371:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491584 00000100:00100000:2.0:1788526543.649380:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491584 00000100:00100000:2.0:1788526543.649658:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788526543.649669:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:7611:x1875405881491584:12345-0@lo:101: 00010000:00010000:2.0:1788526543.649687:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526543.649708:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a0b0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.649740:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.649882:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.649894:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045c00, rc 0) 00000100:00100000:2.0:1788526543.649993:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491584:12345-0@lo:101: Request processed in 325us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.650002:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788526543.650581:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491584:0@lo:101: 00010000:00010000:3.0:1788526543.650603:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.650614:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.650908:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491712:0@lo:501: 00000100:00100000:2.0:1788526543.651376:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.651564:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526543.651626:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491712 00000100:00100000:0.0:1788526543.651633:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491712 00000100:00100000:0.0:1788526543.651735:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788526543.651754:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491712:12345-0@lo:501: 00000100:00100000:0.0:1788526543.652033:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491712:12345-0@lo:501: Request processed in 290us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526543.652041:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788526543.652115:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491712:0@lo:501: 10000000:01000000:2.0:1788526543.652131:0:7611:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788526543.652172:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491840:0@lo:501: 00000100:00100000:2.0:1788526543.652198:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.652449:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526543.652603:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491840 00000100:00100000:1.0:1788526543.652610:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491840 00000100:00100000:1.0:1788526543.652640:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788526543.652657:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491840:12345-0@lo:501: 00000100:00100000:1.0:1788526543.655914:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491840:12345-0@lo:501: Request processed in 3244us (3700us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526543.655930:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788526543.659610:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491840:0@lo:501: 10000000:01000000:2.0:1788526543.659718:0:7611:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788526543.659889:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.659902:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.659916:0:7611:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c274ba0000 10000000:01000000:2.0:1788526543.659926:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788526543.659961:0:7611:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788526543.661497:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788526543.661513:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788526543.661527:0:7611:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788526543.661532:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526543.661554:0:7611:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788526543.661631:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788526543.661636:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788526543.661643:0:7611:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788526543.661646:0:7611:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788526543.661707:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.661720:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.661732:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.662270:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491968:0@lo:101: 00000100:00100000:2.0:1788526543.662367:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.663029:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327480 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.663332:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881491968 00000100:00100000:3.0:1788526543.663341:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881491968 00000100:00100000:3.0:1788526543.663444:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788526543.663455:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:7611:x1875405881491968:12345-0@lo:101: 00010000:00010000:3.0:1788526543.663482:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526543.663504:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a0be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.663535:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a0be expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.663564:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0be expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.663574:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54600, rc 0) 00000100:00100000:3.0:1788526543.663639:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881491968:12345-0@lo:101: Request processed in 186us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.663645:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788526543.664194:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881491968:0@lo:101: 00010000:00010000:2.0:1788526543.664216:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.664226:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.664329:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492096:0@lo:501: 00000100:00100000:2.0:1788526543.664373:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.664446:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327480 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.665171:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492096 00000100:00100000:3.0:1788526543.665179:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492096 00000100:00100000:3.0:1788526543.665233:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788526543.665242:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492096:12345-0@lo:501: 00000100:00100000:3.0:1788526543.665872:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492096:12345-0@lo:501: Request processed in 629us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.665881:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788526543.669628:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492096:0@lo:501: 00000100:00100000:0.0:1788526543.669872:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492224:0@lo:503: 00000100:00100000:0.0:1788526543.670896:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.671002:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788526543.672166:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492224 00000100:00100000:1.0:1788526543.672179:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492224 00000100:00100000:1.0:1788526543.672279:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788526543.672290:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492224:12345-0@lo:503: 00000100:00100000:1.0:1788526543.672601:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492224:12345-0@lo:503: Request processed in 312us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526543.672611:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788526543.672718:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492224:0@lo:503: 00000040:00080000:0.0:1788526543.673370:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526543.673509:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492352:0@lo:502: 00000100:00100000:0.0:1788526543.673573:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.673900:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.674192:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492352 00000100:00100000:3.0:1788526543.674201:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492352 00000100:00100000:3.0:1788526543.674240:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788526543.674248:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492352:12345-0@lo:502: 00000100:00100000:3.0:1788526543.674635:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492352:12345-0@lo:502: Request processed in 386us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.674644:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788526543.676632:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492352:0@lo:502: 00000040:00080000:0.0:1788526543.677945:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788526543.678354:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788526543.678572:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788526543.678650:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788526543.678707:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788526543.678741:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788526543.681893:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492480:0@lo:502: 00000100:00100000:0.0:1788526543.682207:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.682312:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.688889:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492480 00000100:00100000:3.0:1788526543.688909:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492480 00000100:00100000:3.0:1788526543.689158:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788526543.689169:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492480:12345-0@lo:502: 00000100:00100000:3.0:1788526543.689699:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492480:12345-0@lo:502: Request processed in 530us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.689716:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788526543.694694:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492480:0@lo:502: 00000040:00080000:0.0:1788526543.695911:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788526543.695937:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788526543.697770:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788526543.697783:0:7621:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788526543.697790:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526543.697793:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788526543.697799:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788526543.697815:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98c27b1f6600) 00000020:00000080:2.0:1788526543.697849:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788526543.697856:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788526543.697922:0:7621:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c274ba0000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788526543.697931:0:7621:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788526543.697938:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x367645d450b3a0d3 00010000:00010000:2.0:1788526543.703850:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788526543.705443:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788526543.711678:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788526543.712278:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788526543.720685:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788526543.722205:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788526543.724719:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788526543.724738:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526543.724760:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526543.724763:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788526543.724768:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526543.724773:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526543.724775:0:7621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788526543.724778:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788526543.724780:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788526543.724863:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526543.724867:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526543.724868:0:7621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788526543.724872:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788526543.725564:0:7611:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788526543.725584:0:7611:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788526543.725612:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.725627:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526543.725636:0:7611:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c274ba0000 from 1 10000000:01000000:2.0:1788526543.725640:0:7611:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788526543.725687:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.725696:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.725710:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.725752:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492608:0@lo:101: 00000100:00100000:2.0:1788526543.725842:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.725888:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2483279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.726089:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492608 00000100:00100000:3.0:1788526543.726099:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492608 00000100:00100000:3.0:1788526543.726165:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788526543.726177:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:7611:x1875405881492608:12345-0@lo:101: 00010000:00010000:3.0:1788526543.726194:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526543.726213:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a0da expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.726247:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a0da expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.726259:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0da expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.726268:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526543.726310:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492608:12345-0@lo:101: Request processed in 137us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.726317:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788526543.726707:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492608:0@lo:101: 00010000:00010000:2.0:1788526543.726726:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.726764:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.726860:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492736:0@lo:501: 00000100:00100000:2.0:1788526543.726895:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.726911:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2483279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.727216:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492736 00000100:00100000:3.0:1788526543.727222:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492736 00000100:00100000:3.0:1788526543.727260:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788526543.727290:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492736:12345-0@lo:501: 00000100:00100000:3.0:1788526543.727631:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492736:12345-0@lo:501: Request processed in 362us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.727638:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788526543.727669:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492736:0@lo:501: 00000100:00100000:3.0:1788526543.727711:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492864:0@lo:503: 00000100:00100000:3.0:1788526543.727868:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526543.727892:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c26e4f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.727908:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492864 00000100:00100000:3.0:1788526543.727912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492864 00000100:00100000:3.0:1788526543.727932:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788526543.727938:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492864:12345-0@lo:503: 00000100:00100000:3.0:1788526543.729300:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492864:12345-0@lo:503: Request processed in 1356us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.729311:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788526543.729804:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492864:0@lo:503: 00000040:00080000:2.0:1788526543.731723:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526543.732359:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492992:0@lo:502: 00000100:00100000:2.0:1788526543.733454:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.733733:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2483279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.744723:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881492992 00000100:00100000:3.0:1788526543.744750:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881492992 00000100:00100000:3.0:1788526543.744827:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788526543.744838:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492992:12345-0@lo:502: 00000100:00100000:3.0:1788526543.745380:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881492992:12345-0@lo:502: Request processed in 542us (11927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.745425:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788526543.745693:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881492992:0@lo:502: 00000040:00080000:3.0:1788526543.746205:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788526543.746262:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788526543.746306:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493120:0@lo:502: 00000100:00100000:3.0:1788526543.746364:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526543.746487:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526543.746638:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493120 00000100:00100000:0.0:1788526543.746646:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493120 00000100:00100000:0.0:1788526543.746730:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788526543.746740:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881493120:12345-0@lo:502: 00000100:00100000:0.0:1788526543.746956:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881493120:12345-0@lo:502: Request processed in 208us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526543.746964:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788526543.747053:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493120:0@lo:502: 00000040:00080000:2.0:1788526543.747193:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788526543.747205:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788526543.748711:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526543.748726:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526543.748738:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788526543.748816:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c274ba0000 00000020:00000080:1.0:1788526543.748820:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788526543.748846:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526543.748850:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526543.748851:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788526543.748855:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788526543.749168:0:7611:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788526543.749184:0:7611:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788526543.749239:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.749257:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526543.749309:0:7611:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788526543.749312:0:7611:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c274ba0000 10000000:01000000:3.0:1788526543.749316:0:7611:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c274ba0000 10000000:01000000:3.0:1788526543.749321:0:7611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788526543.749332:0:7611:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788526543.749426:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788526543.749436:0:7611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788526543.749452:0:7611:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c274ba0000 from 1 10000000:01000000:3.0:1788526543.749455:0:7611:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788526543.749512:0:7611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.749521:0:7611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.749544:0:7611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.749569:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493248:0@lo:101: 00000100:00100000:0.0:1788526543.749735:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.750210:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526543.750253:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493248 00000100:00100000:2.0:1788526543.750261:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493248 00000100:00100000:2.0:1788526543.750351:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788526543.750361:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881493248:12345-0@lo:101: 00010000:00010000:2.0:1788526543.750376:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526543.750432:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a0e8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.750458:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.750479:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.750500:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045800, rc 0) 00000100:00100000:2.0:1788526543.750553:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493248:12345-0@lo:101: Request processed in 193us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.750560:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788526543.750571:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493248:0@lo:101: 00010000:00010000:0.0:1788526543.750587:0:7611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526543.750596:0:7611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526543.751249:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493376:0@lo:501: 00000100:00100000:0.0:1788526543.751291:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.751337:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.751359:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493376 00000100:00100000:3.0:1788526543.751365:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493376 00000100:00100000:3.0:1788526543.751443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788526543.751451:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493376:12345-0@lo:501: 00000100:00100000:3.0:1788526543.751723:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493376:12345-0@lo:501: Request processed in 272us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.751739:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788526543.751774:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493376:0@lo:501: 00000100:00100000:0.0:1788526543.751810:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493504:0@lo:503: 00000100:00100000:0.0:1788526543.751852:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.751876:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526543.751965:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493504 00000100:00100000:2.0:1788526543.751971:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493504 00000100:00100000:2.0:1788526543.752001:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788526543.752008:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493504:12345-0@lo:503: 00000100:00100000:2.0:1788526543.752178:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493504:12345-0@lo:503: Request processed in 170us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.752186:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788526543.752197:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493504:0@lo:503: 00000040:00080000:0.0:1788526543.752748:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526543.752876:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493632:0@lo:502: 00000100:00100000:0.0:1788526543.752926:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.752966:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.753007:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493632 00000100:00100000:3.0:1788526543.753014:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493632 00000100:00100000:3.0:1788526543.753050:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788526543.753066:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493632:12345-0@lo:502: 00000100:00100000:3.0:1788526543.753270:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493632:12345-0@lo:502: Request processed in 212us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.753277:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788526543.753982:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493632:0@lo:502: 00000040:00080000:0.0:1788526543.754322:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788526543.754383:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788526543.754456:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788526543.754505:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788526543.754540:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788526543.754590:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788526543.754629:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788526543.755102:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788526543.755155:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788526543.755192:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788526543.755228:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788526543.755310:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788526543.755346:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788526543.755377:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788526543.755743:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788526543.755929:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788526543.755965:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788526543.756015:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788526543.756137:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788526543.756172:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788526543.756243:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788526543.756282:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788526543.756317:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788526543.756365:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788526543.756855:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788526543.756892:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788526543.756949:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788526543.756999:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788526543.757104:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788526543.757154:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788526543.757182:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788526543.757210:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788526543.757242:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788526543.757288:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788526543.757322:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788526543.757369:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788526543.757441:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788526543.757509:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493760:0@lo:502: 00000100:00100000:0.0:1788526543.757728:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.757884:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526543.758055:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493760 00000100:00100000:1.0:1788526543.758137:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493760 00000100:00100000:1.0:1788526543.758337:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788526543.758353:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493760:12345-0@lo:502: 00000100:00100000:1.0:1788526543.759166:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881493760:12345-0@lo:502: Request processed in 817us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526543.759175:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788526543.759908:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881493760:0@lo:502: 00000040:00080000:0.0:1788526543.760141:0:7611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788526543.760165:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788526543.761122:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788526543.761159:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98c27b7ab300) 00000020:00000080:3.0:1788526543.761184:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788526543.761276:0:7626:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c274ba0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788526543.761280:0:7626:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c274ba0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788526543.761283:0:7626:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c274ba0000 3 00010000:00080000:3.0:1788526543.761310:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27b7b1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1788526543.763931:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788526543.764583:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788526543.764635:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788526543.764655:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x367645d450b3a0fd 00000100:00080000:2.0:1788526543.764691:0:7626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788526543.764699:0:7626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c27b7b1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1788526543.764743:0:7626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c2741ec000 x1875405881493888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526543.765436:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881493888:0@lo:38: 00000100:00100000:3.0:1788526543.765565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526543.765671:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881493888 00000100:00100000:1.0:1788526543.765679:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881493888 00000100:00100000:1.0:1788526543.765719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526543.765727:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875405881493888:12345-0@lo:38: 00010000:00080000:1.0:1788526543.765753:0:5824:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1788526543.765800:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x367645d450b3a104 00000004:00100000:1.0:1788526543.765817:0:5824:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788526543.765854:0:5824:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e6800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788526543.767819:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788526543.768411:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881494144:0@lo:400: 00000100:00100000:0.0:1788526543.768494:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.768546:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788526543.768552:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881494016:0@lo:400: 00000100:00100000:0.0:1788526543.768577:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.768614:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881494272:0@lo:400: 00000100:00100000:0.0:1788526543.768645:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.768686:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494144 00000100:00100000:0.0:1788526543.768695:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494144 00000100:00100000:0.0:1788526543.768751:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494016 00000100:00100000:0.0:1788526543.768754:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494016 00000100:00100000:0.0:1788526543.768842:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788526543.768851:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881494144:12345-0@lo:400: 00000100:00100000:0.0:1788526543.768908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881494144:12345-0@lo:400: Request processed in 58us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526543.768916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788526543.768933:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788526543.768938:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881494016:12345-0@lo:400: 00000100:00100000:0.0:1788526543.768963:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881494016:12345-0@lo:400: Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526543.768969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788526543.768993:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494272 00000100:00100000:0.0:1788526543.768997:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494272 00000100:00100000:0.0:1788526543.769035:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788526543.769043:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881494272:12345-0@lo:400: 00000100:00100000:0.0:1788526543.769077:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881494272:12345-0@lo:400: Request processed in 36us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526543.769083:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788526543.769100:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526543.769105:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526543.769140:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a4000 x1875405881494272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526543.769156:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881494272:0@lo:400: 00010000:00080000:0.0:1788526543.769201:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a5f80 x1875405881494016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526543.769210:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881494016:0@lo:400: 00010000:00080000:0.0:1788526543.769220:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a7800 x1875405881494144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526543.769228:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881494144:0@lo:400: 00000100:00100000:1.0:1788526543.769702:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875405881493888:12345-0@lo:38: Request processed in 3972us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526543.769711:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1788526543.770948:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788526543.771843:0:7628:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98c2430a7800 x1875405881494400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526543.771856:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4c00 going to sleep for 0 seconds 00000020:01000000:2.0:1788526543.771977:0:7611:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788526543.771996:0:7611:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788526543.772022:0:7611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.772040:0:7611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788526543.772100:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788526543.772102:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526543.772103:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526543.772105:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526543.772106:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526543.772107:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526543.772109:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526543.772111:0:7611:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526543.772112:0:7611:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526543.772113:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526543.772115:0:7611:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526543.772119:0:7611:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788526543.772121:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788526543.772122:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526543.772123:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526543.772124:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526543.772125:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526543.772126:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526543.772127:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526543.772129:0:7611:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526543.772130:0:7611:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526543.772130:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526543.772131:0:7611:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526543.772147:0:7611:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788526543.772157:0:7611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881494528:0@lo:253: 00000100:00100000:2.0:1788526543.772231:0:7611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.772284:0:7611:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327480 going to sleep for 11 seconds 00010000:00080000:3.0:1788526543.773159:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2741ec000 x1875405881493888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526543.773171:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788526543.773181:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788526543.773190:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788526543.773195:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788526543.773199:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788526543.773206:0:3277:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000215e5971): req@ffff98c2430a7800 x1875405881494400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526543.774516:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494528 00000100:00100000:2.0:1788526543.774539:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494528 00000100:00100000:2.0:1788526543.774602:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788526543.774612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:7611:x1875405881494528:12345-0@lo:253: 20000000:01000000:2.0:1788526543.774667:0:5817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788526543.774681:0:5817:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788526543.777277:0:7628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526543.777379:0:7628:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.778692:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881493888:0@lo:38: 00000100:00100000:2.0:1788526543.783286:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494400 00000100:00100000:2.0:1788526543.783313:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494400 00000100:00100000:2.0:1788526543.783457:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526543.783468:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875405881494400:12345-0@lo:901: 00000100:00100000:2.0:1788526543.783902:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1875405881494400:12345-0@lo:901: Request processed in 436us (6637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526543.783911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788526543.786350:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526543.786863:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c2430a7800 x1875405881494400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788526559 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526543.786884:0:7628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1875405881494400:0@lo:901: 20000000:01000000:0.0:1788526543.819217:0:5817:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788526543.819241:0:5817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788526543.820264:0:5838:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788526543.820272:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788526543.820295:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.820314:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a047 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.820324:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.820372:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526543.820409:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 15 pid: 5818 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526543.820436:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881494656:0@lo:104: 00000100:00100000:2.0:1788526543.820520:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526543.820580:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c26e4f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526543.820854:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494656 00000100:00100000:3.0:1788526543.820867:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494656 00000100:00100000:3.0:1788526543.820935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526543.820944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881494656:12345-0@lo:104: 00010000:00010000:3.0:1788526543.820958:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821037:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788526543.821045:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:5838:x1875405881494656:12345-0@lo:104: Request processed in 102us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.821052:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788526543.821201:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526543.821207:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821215:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526543.821219:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821228:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526543.821236:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526543.821242:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788526543.821276:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821299:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526543.821320:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821327:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a04e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821345:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526543.821346:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526543.821348:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526543.821455:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741edf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875405881494656:0@lo:104: 00010000:00010000:1.0:1788526543.821482:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526543.821654:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881494784:0@lo:103: 00000100:00100000:1.0:1788526543.821703:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526543.821889:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494784 00000100:00100000:3.0:1788526543.821895:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494784 00010000:00010000:3.0:1788526543.821916:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 16 pid: 5818 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526543.821950:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526543.821957:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:3281:x1875405881494784:12345-0@lo:103: 00010000:00010000:3.0:1788526543.821970:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526543.821975:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 16 pid: 5818 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.821986:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 16 pid: 5818 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822001:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030c00/0x367645d450b3a04e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a047 expref: 16 pid: 5818 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822017:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822046:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788526543.822177:0:5809:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002602471s 00010000:00010000:3.0:1788526543.822186:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822193:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822200:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822206:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822212:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526543.822217:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822226:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822242:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822252:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526543.822289:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:3281:x1875405881494784:12345-0@lo:103: Request processed in 332us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526543.822296:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526543.822336:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881494784:0@lo:103: 00010000:00010000:3.0:1788526543.822356:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822364:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526543.822370:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044600/0x367645d450b3a10b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526543.836937:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:7611:x1875405881494528:12345-0@lo:253: Request processed in 62312us (64691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526543.836955:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788526543.837091:0:7611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7611:1875405881494528:0@lo:253: 10000000:01000000:2.0:1788526543.837109:0:7611:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788526543.837112:0:7611:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526543.837114:0:7611:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526543.837131:0:7611:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526543.837132:0:7611:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526543.837134:0:7611:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526543.837135:0:7611:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526543.837137:0:7611:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526543.837139:0:7611:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788526543.837141:0:7611:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788526543.837143:0:7611:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526543.837144:0:7611:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788526543.837163:0:7611:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788526543.850991:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526543.851353:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526543.851652:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526543.851835:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526543.852031:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526543.853021:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788526543.855888:0:7611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788526544.083639:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788526544.143989:0:7611:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788526544.144001:0:7611:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788526544.144231:0:7611:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788526544.144336:0:7611:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788526545.107597:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526546.132591:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526546.388952:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881494912:0@lo:13: 00000100:00100000:2.0:1788526546.389045:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526546.390292:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881494912 00000100:00100000:3.0:1788526546.390309:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881494912 00000100:00100000:1.0:1788526546.390507:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526546.390519:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881494912:12345-0@lo:13: 00002000:00000024:1.0:1788526546.390565:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526546.390656:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881494912:12345-0@lo:13: Request processed in 140us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526546.390663:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788526546.390678:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788526546.391352:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9d9c00 x1875405881494912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526546.391526:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881494912:0@lo:13: 00010000:00010000:3.0:1788526547.160809:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526548.184661:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526548.950309:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526548.950347:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881495040:0@lo:400: 00000100:00100000:0.0:1788526548.950457:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526548.950539:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495040 00000100:00100000:0.0:1788526548.950547:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495040 00000100:00100000:0.0:1788526548.950612:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788526548.950622:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:3278:x1875405881495040:12345-0@lo:400: 00000100:00100000:0.0:1788526548.950674:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:3278:x1875405881495040:12345-0@lo:400: Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526548.950681:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788526548.950734:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881495040:0@lo:400: 00000100:00100000:2.0:1788526548.951193:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881495168:0@lo:400: 00000100:00100000:2.0:1788526548.951237:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526548.951560:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495168 00000100:00100000:0.0:1788526548.951567:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495168 00000100:00100000:0.0:1788526548.951612:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788526548.951619:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881495168:12345-0@lo:400: 00000100:00100000:0.0:1788526548.951660:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881495168:12345-0@lo:400: Request processed in 41us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526548.951667:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788526548.951788:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249743800 x1875405881495168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526548.951802:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881495168:0@lo:400: 00000100:00100000:1.0:1788526548.953960:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881495424:0@lo:400: 00000100:00100000:2.0:1788526548.953991:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881495552:0@lo:400: 00000100:00100000:2.0:1788526548.954040:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526548.954041:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526548.954227:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495424 00000100:00100000:0.0:1788526548.954237:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495424 00000100:00100000:0.0:1788526548.954306:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788526548.954325:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881495424:12345-0@lo:400: 00000100:00100000:3.0:1788526548.954358:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881495296:0@lo:400: 00000100:00100000:1.0:1788526548.957085:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495552 00000100:00100000:1.0:1788526548.957105:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495552 00000100:00100000:0.0:1788526548.957109:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881495424:12345-0@lo:400: Request processed in 2788us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526548.957123:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526548.957808:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788526548.957822:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881495552:12345-0@lo:400: 00000100:00100000:1.0:1788526548.957896:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881495552:12345-0@lo:400: Request processed in 80us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526548.957904:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788526548.957958:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249742d80 x1875405881495552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526548.957986:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881495552:0@lo:400: 00010000:00080000:1.0:1788526548.958027:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249741880 x1875405881495424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526548.958036:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881495424:0@lo:400: 00000100:00080000:1.0:1788526548.958070:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526548.958076:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526548.961613:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526548.961696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495296 00000100:00100000:0.0:1788526548.961707:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495296 00000100:00100000:0.0:1788526548.961811:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788526548.961822:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881495296:12345-0@lo:400: 00000100:00100000:0.0:1788526548.961897:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881495296:12345-0@lo:400: Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526548.961904:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788526548.961977:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788526548.962049:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249743800 x1875405881495296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526548.962079:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881495296:0@lo:400: 00010000:00010000:2.0:1788526549.203616:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788526549.971450:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788526549.971461:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c27453b800 from 30 10000000:01000000:1.0:1788526549.971467:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526549.971531:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526549.971545:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526549.971560:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526549.971589:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495680:0@lo:101: 00000100:00100000:1.0:1788526549.971683:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526549.971740:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495680 00000100:00100000:3.0:1788526549.971749:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495680 00000100:00100000:1.0:1788526549.971751:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27fbfea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526549.972727:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788526549.972740:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881495680:12345-0@lo:101: 00010000:00010000:3.0:1788526549.972760:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526549.973241:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a112 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526549.973372:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a112 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526549.973410:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a112 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526549.973422:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55000, rc 0) 00000100:00100000:3.0:1788526549.973509:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881495680:12345-0@lo:101: Request processed in 770us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526549.973518:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788526549.974308:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495680:0@lo:101: 00010000:00010000:1.0:1788526549.974335:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526549.974346:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526549.975083:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788526549.978001:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526549.981030:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788526549.981130:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:0.0:1788526549.982710:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:0.0:1788526549.982779:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:0.0:1788526549.982815:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:0.0:1788526549.982863:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:0.0:1788526549.982914:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:0.0:1788526549.982949:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:0.0:1788526549.982989:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:0.0:1788526549.983015:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:0.0:1788526549.983042:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:0.0:1788526549.983085:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:0.0:1788526549.983117:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:0.0:1788526549.983670:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:0.0:1788526549.983743:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:0.0:1788526549.983778:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:0.0:1788526549.983811:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:0.0:1788526549.983859:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:0.0:1788526549.983893:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:0.0:1788526549.983927:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:0.0:1788526549.983979:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:0.0:1788526549.984014:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:0.0:1788526549.984044:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:0.0:1788526549.984090:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:0.0:1788526549.985706:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:0.0:1788526549.985759:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:0.0:1788526549.985824:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:0.0:1788526549.985861:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:0.0:1788526549.985959:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:0.0:1788526549.985967:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788526549.986112:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495808:0@lo:501: 00000100:00100000:0.0:1788526549.987009:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526549.987068:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526549.987533:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495808 00000100:00100000:2.0:1788526549.987545:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495808 00000100:00100000:2.0:1788526549.987610:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788526549.987620:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881495808:12345-0@lo:501: 00000100:00100000:2.0:1788526549.987892:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881495808:12345-0@lo:501: Request processed in 273us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526549.987899:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788526549.988445:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495808:0@lo:501: 00000100:00100000:0.0:1788526549.988507:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495936:0@lo:503: 00000100:00100000:0.0:1788526549.988556:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526549.988590:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526549.988798:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881495936 00000100:00100000:2.0:1788526549.988808:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881495936 00000100:00100000:2.0:1788526549.988843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788526549.988851:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881495936:12345-0@lo:503: 00000100:00100000:2.0:1788526549.989008:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881495936:12345-0@lo:503: Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526549.989015:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788526549.989562:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881495936:0@lo:503: 00000040:00080000:0.0:1788526549.990858:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526549.990955:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496064:0@lo:502: 00000100:00100000:0.0:1788526549.991037:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526549.991559:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c87e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526549.991606:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496064 00000100:00100000:2.0:1788526549.991613:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496064 00000100:00100000:2.0:1788526549.991664:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788526549.991673:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881496064:12345-0@lo:502: 00000100:00100000:2.0:1788526549.991967:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881496064:12345-0@lo:502: Request processed in 294us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526549.991974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788526549.992045:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496064:0@lo:502: 00000040:00080000:0.0:1788526549.992794:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788526549.992860:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:0.0:1788526549.992897:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:0.0:1788526549.992952:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:0.0:1788526549.992990:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:0.0:1788526549.993037:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:0.0:1788526549.993070:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:0.0:1788526549.993098:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:0.0:1788526549.995381:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:0.0:1788526549.995526:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:0.0:1788526549.995566:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:0.0:1788526549.995624:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:0.0:1788526549.995657:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:0.0:1788526549.995689:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:0.0:1788526549.995734:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:0.0:1788526549.995769:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:0.0:1788526549.995799:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:0.0:1788526549.995843:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:0.0:1788526549.995886:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:0.0:1788526549.995921:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:0.0:1788526549.995969:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:0.0:1788526549.996003:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:0.0:1788526549.996059:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:0.0:1788526549.996109:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:0.0:1788526549.996159:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:0.0:1788526549.996195:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:0.0:1788526549.996242:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:0.0:1788526549.996280:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:0.0:1788526549.996324:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:0.0:1788526549.996375:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:0.0:1788526549.996437:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:0.0:1788526549.996471:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:0.0:1788526549.996504:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:0.0:1788526549.996552:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:0.0:1788526549.996588:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:0.0:1788526549.996636:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:0.0:1788526549.996670:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000100:00100000:0.0:1788526549.996734:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496192:0@lo:502: 00000100:00100000:0.0:1788526549.996845:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526549.996908:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c87e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526549.997158:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496192 00000100:00100000:2.0:1788526549.997168:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496192 00000100:00100000:2.0:1788526549.997233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788526549.997252:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881496192:12345-0@lo:502: 00000100:00100000:3.0:1788526549.997622:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881496192:12345-0@lo:502: Request processed in 376us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526549.997633:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788526549.999022:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496192:0@lo:502: 00000040:00080000:0.0:1788526549.999493:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:0.0:1788526549.999512:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:0.0:1788526550.007562:0:7893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000020:01000000:3.0:1788526550.008358:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788526550.008379:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788526550.008422:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.008450:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526550.008466:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788526550.008469:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788526550.008474:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788526550.008530:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.008538:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.008551:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526550.008585:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496320:0@lo:101: 00000100:00100000:3.0:1788526550.008683:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.008731:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2461e6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.008826:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496320 00000100:00100000:2.0:1788526550.008835:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496320 00000100:00100000:2.0:1788526550.008873:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788526550.008881:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881496320:12345-0@lo:101: 00010000:00010000:2.0:1788526550.008894:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526550.008905:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a120 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.008927:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a120 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.008947:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a120 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.008956:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044600, rc 0) 00000100:00100000:2.0:1788526550.008998:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496320:12345-0@lo:101: Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526550.009005:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788526550.010345:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496320:0@lo:101: 00010000:00010000:3.0:1788526550.010371:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.010383:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526550.010953:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788526550.011369:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526550.011661:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788526550.011711:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:3.0:1788526550.011746:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:3.0:1788526550.011791:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:3.0:1788526550.011829:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:3.0:1788526550.011857:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:3.0:1788526550.011918:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:3.0:1788526550.011925:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788526550.011990:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496448:0@lo:501: 00000100:00100000:3.0:1788526550.012072:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.012132:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2461e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526550.013890:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496448 00000100:00100000:1.0:1788526550.013902:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496448 00000100:00100000:1.0:1788526550.013951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788526550.013961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496448:12345-0@lo:501: 00000100:00100000:1.0:1788526550.014280:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496448:12345-0@lo:501: Request processed in 319us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.014288:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788526550.014353:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496448:0@lo:501: 00000100:00100000:1.0:1788526550.014544:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496576:0@lo:503: 00000100:00100000:1.0:1788526550.014596:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.014629:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247e60900 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.014757:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496576 00000100:00100000:2.0:1788526550.014762:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496576 00000100:00100000:2.0:1788526550.014793:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788526550.014801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496576:12345-0@lo:503: 00000100:00100000:2.0:1788526550.015007:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496576:12345-0@lo:503: Request processed in 206us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526550.015014:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788526550.015779:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496576:0@lo:503: 00000040:00080000:1.0:1788526550.020218:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526550.020375:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496704:0@lo:502: 00000100:00100000:1.0:1788526550.020489:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.020551:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496704 00000100:00100000:1.0:1788526550.020560:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496704 00000100:00100000:1.0:1788526550.020607:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788526550.020617:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496704:12345-0@lo:502: 00000100:00100000:1.0:1788526550.020854:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496704:12345-0@lo:502: Request processed in 237us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.020862:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788526550.020925:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247e60900 going to sleep for 11 seconds 00000100:00100000:1.0:1788526550.020949:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496704:0@lo:502: 00000040:00080000:1.0:1788526550.021221:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788526550.021267:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:1.0:1788526550.021316:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788526550.021362:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788526550.030716:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788526550.030850:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788526550.030940:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:1.0:1788526550.030978:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788526550.031010:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:1.0:1788526550.031079:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496832:0@lo:502: 00000100:00100000:1.0:1788526550.031196:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.031244:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a366cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.031334:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496832 00000100:00100000:3.0:1788526550.031345:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496832 00000100:00100000:3.0:1788526550.031447:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788526550.031459:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496832:12345-0@lo:502: 00000100:00100000:3.0:1788526550.031745:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496832:12345-0@lo:502: Request processed in 288us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.031754:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788526550.032258:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496832:0@lo:502: 00000040:00080000:2.0:1788526550.032957:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:2.0:1788526550.032979:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000020:01000000:0.0:1788526550.041649:0:7900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526550.041668:0:7900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526550.041671:0:7900:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788526550.041678:0:7900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788526550.041680:0:7900:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788526550.041712:0:7900:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526550.041716:0:7900:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526550.041717:0:7900:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788526550.041720:0:7900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788526550.042275:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788526550.042302:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788526550.042328:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.042343:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526550.042358:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788526550.042362:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c27453b800 from 1 10000000:01000000:2.0:1788526550.042373:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788526550.042636:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.042647:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.042662:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.042691:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496960:0@lo:101: 00000100:00100000:2.0:1788526550.042778:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.042829:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:1.0:1788526550.043148:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881496960 00000100:00100000:1.0:1788526550.043239:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881496960 00000100:00100000:1.0:1788526550.043360:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788526550.043373:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881496960:12345-0@lo:101: 00010000:00010000:1.0:1788526550.043413:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526550.043431:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a12e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526550.043463:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a12e expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526550.043476:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a12e expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526550.043487:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241663400, rc 0) 00000100:00100000:1.0:1788526550.043540:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881496960:12345-0@lo:101: Request processed in 170us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.043554:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788526550.043633:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881496960:0@lo:101: 00010000:00010000:2.0:1788526550.043649:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.043659:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.043741:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497088:0@lo:501: 00000100:00100000:2.0:1788526550.043767:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.048451:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.052325:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497088 00000100:00100000:3.0:1788526550.052356:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497088 00000100:00100000:3.0:1788526550.052691:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788526550.052704:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881497088:12345-0@lo:501: 00000100:00100000:3.0:1788526550.053056:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881497088:12345-0@lo:501: Request processed in 354us (9285us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788526550.053065:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788526550.053158:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497088:0@lo:501: 10000000:01000000:2.0:1788526550.053194:0:5820:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788526550.053264:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497216:0@lo:501: 00000100:00100000:2.0:1788526550.053321:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.053356:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.053599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497216 00000100:00100000:3.0:1788526550.053605:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497216 00000100:00100000:3.0:1788526550.053640:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788526550.053646:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881497216:12345-0@lo:501: 00000100:00100000:3.0:1788526550.053780:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881497216:12345-0@lo:501: Request processed in 133us (466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788526550.053786:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788526550.054035:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497216:0@lo:501: 10000000:01000000:2.0:1788526550.054067:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788526550.054079:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.054090:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526550.054101:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788526550.054104:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c248515800 from 30 10000000:01000000:2.0:1788526550.054107:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788526550.054137:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.054145:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.054154:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.054179:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497344:0@lo:101: 00000100:00100000:2.0:1788526550.054209:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.054234:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.054343:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497344 00000100:00100000:3.0:1788526550.054347:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497344 00000100:00100000:3.0:1788526550.054369:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788526550.054376:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881497344:12345-0@lo:101: 00010000:00010000:3.0:1788526550.054409:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526550.054422:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a13c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.054718:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a13c expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.054730:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a13c expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.054739:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55c00, rc 0) 00000100:00100000:3.0:1788526550.054777:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497344:12345-0@lo:101: Request processed in 401us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.054783:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788526550.054857:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497344:0@lo:101: 00010000:00010000:2.0:1788526550.054873:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.054882:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.054923:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497472:0@lo:501: 00000100:00100000:2.0:1788526550.054947:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.054973:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.055082:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497472 00000100:00100000:3.0:1788526550.055087:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497472 00000100:00100000:3.0:1788526550.055105:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788526550.055110:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497472:12345-0@lo:501: 00000100:00100000:3.0:1788526550.057581:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497472:12345-0@lo:501: Request processed in 2457us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.057597:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788526550.057645:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497472:0@lo:501: 00000100:00100000:0.0:1788526550.057698:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497600:0@lo:503: 00000100:00100000:0.0:1788526550.057753:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526550.057784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497600 00000100:00100000:0.0:1788526550.057791:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497600 00000100:00100000:0.0:1788526550.057838:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788526550.057848:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497600:12345-0@lo:503: 00000100:00100000:0.0:1788526550.058038:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497600:12345-0@lo:503: Request processed in 192us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526550.058045:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788526550.058088:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c87e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526550.058099:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497600:0@lo:503: 00000100:00100000:1.0:1788526550.068873:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7901:1875405881497728:0@lo:502: 00000100:00100000:1.0:1788526550.068970:0:7901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.069054:0:7901:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c269791900 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.072699:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497728 00000100:00100000:3.0:1788526550.072723:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497728 00000100:00100000:3.0:1788526550.072841:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788526550.072852:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:7901:x1875405881497728:12345-0@lo:502: 00000100:00100000:3.0:1788526550.073311:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:7901:x1875405881497728:12345-0@lo:502: Request processed in 459us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.073328:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788526550.073451:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7901:1875405881497728:0@lo:502: 00000100:00100000:2.0:1788526550.073534:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7901:1875405881497856:0@lo:502: 00000100:00100000:2.0:1788526550.073586:0:7901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.074303:0:7901:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526550.074415:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497856 00000100:00100000:1.0:1788526550.074422:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497856 00000100:00100000:1.0:1788526550.076599:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788526550.076613:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:7901:x1875405881497856:12345-0@lo:502: 00000100:00100000:1.0:1788526550.077031:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:7901:x1875405881497856:12345-0@lo:502: Request processed in 418us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.077041:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788526550.077720:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7901:1875405881497856:0@lo:502: 00000040:00080000:2.0:1788526550.077769:0:7901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788526550.077955:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788526550.077964:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788526550.077977:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.077988:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526550.078000:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788526550.078003:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c248515800 from 5 10000000:01000000:2.0:1788526550.078006:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788526550.078049:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.078057:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.078068:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.078099:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497984:0@lo:101: 00000100:00100000:2.0:1788526550.079304:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.079682:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881497984 00000100:00100000:3.0:1788526550.079695:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881497984 00000100:00100000:3.0:1788526550.079769:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788526550.079780:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881497984:12345-0@lo:101: 00010000:00010000:3.0:1788526550.079806:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526550.079838:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54400/0x367645d450b3a151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a14a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.079874:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54400/0x367645d450b3a151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a14a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.079889:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54400/0x367645d450b3a151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a14a expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.079901:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54400, rc 0) 00000100:00100000:2.0:1788526550.079992:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298840 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.080626:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881497984:12345-0@lo:101: Request processed in 844us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.080634:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788526550.080700:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881497984:0@lo:101: 00010000:00010000:3.0:1788526550.080723:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.080746:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526550.080817:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498112:0@lo:256: 00000100:00100000:3.0:1788526550.080857:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.080876:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.080892:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498112 00000100:00100000:3.0:1788526550.080897:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498112 00000100:00100000:3.0:1788526550.080924:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788526550.080931:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881498112:12345-0@lo:256: 20000000:01000000:3.0:1788526550.080950:0:5815:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788526550.080967:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788526550.080970:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788526550.081050:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881498112:12345-0@lo:256: Request processed in 119us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.081057:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788526550.081084:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498112:0@lo:256: 10000000:01000000:3.0:1788526550.081126:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788526550.081133:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.081142:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526550.081152:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788526550.081156:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788526550.081158:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788526550.081201:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.081210:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.081219:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526550.081230:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498240:0@lo:101: 00000100:00100000:3.0:1788526550.081255:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.081267:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.081278:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498240 00000100:00100000:3.0:1788526550.081281:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498240 00000100:00100000:3.0:1788526550.081308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788526550.083471:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881498240:12345-0@lo:101: 00010000:00010000:3.0:1788526550.083505:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526550.083540:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a158 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.083576:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a158 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.083588:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a158 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526550.083599:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55400, rc 0) 00000100:00100000:3.0:1788526550.083689:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881498240:12345-0@lo:101: Request processed in 2374us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.083699:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788526550.083710:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498240:0@lo:101: 00010000:00010000:0.0:1788526550.083735:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526550.083745:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526550.083813:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498368:0@lo:501: 00000100:00100000:0.0:1788526550.083856:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526550.083896:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247c87e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.084097:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498368 00000100:00100000:3.0:1788526550.084103:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498368 00000100:00100000:3.0:1788526550.084143:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788526550.084151:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881498368:12345-0@lo:501: 00000100:00100000:3.0:1788526550.084671:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881498368:12345-0@lo:501: Request processed in 519us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.084679:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788526550.084839:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498368:0@lo:501: 00000100:00100000:1.0:1788526550.084880:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498496:0@lo:503: 00000100:00100000:1.0:1788526550.084922:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.084954:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.085001:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498496 00000100:00100000:3.0:1788526550.085005:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498496 00000100:00100000:3.0:1788526550.085033:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788526550.085040:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881498496:12345-0@lo:503: 00000100:00100000:3.0:1788526550.085501:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881498496:12345-0@lo:503: Request processed in 460us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.085509:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788526550.085592:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881498496:0@lo:503: 00000100:00100000:1.0:1788526550.088154:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7905:1875405881498624:0@lo:502: 00000100:00100000:1.0:1788526550.088255:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.088523:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.088597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498624 00000100:00100000:2.0:1788526550.088605:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498624 00000100:00100000:2.0:1788526550.088656:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788526550.088667:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:7905:x1875405881498624:12345-0@lo:502: 00000100:00100000:2.0:1788526550.089007:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:7905:x1875405881498624:12345-0@lo:502: Request processed in 342us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526550.089015:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788526550.089114:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7905:1875405881498624:0@lo:502: 00000020:01000000:1.0:1788526550.089146:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788526550.089154:0:7905:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788526550.089172:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526550.089174:0:7905:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788526550.089180:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788526550.089191:0:7905:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1788526550.089219:0:7905:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788526550.089222:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788526550.089256:0:7905:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c142aa4c80) 00000020:00000080:1.0:1788526550.089285:0:7905:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788526550.089303:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788526550.089584:0:7905:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788526550.089590:0:7905:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788526550.089603:0:7905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3a16d 00010000:00080000:1.0:1788526550.089638:0:7905:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c243185000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1788526550.091029:0:7905:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788526550.091853:0:7905:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788526550.091871:0:7905:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788526550.092794:0:7905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788526550.093052:0:7905:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788526550.093112:0:7905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788526550.098226:0:7905:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788526550.099032:0:7906:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788526550.099038:0:7906:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788526550.101028:0:7905:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788526550.101044:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788526550.101086:0:7905:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788526550.101114:0:7905:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3a174 00000100:00080000:1.0:1788526550.101129:0:7905:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788526550.101137:0:7905:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c243185000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526550.101951:0:7905:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c249740380 x1875405881498752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788526550.101981:0:7905:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788526550.102083:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881498880:0@lo:400: 00000100:00100000:1.0:1788526550.102170:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.102216:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526550.102231:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881499008:0@lo:400: 00000100:00100000:1.0:1788526550.102270:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.102312:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881499136:0@lo:400: 00000100:00100000:1.0:1788526550.102353:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.102377:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526550.102383:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881499264:0@lo:400: 00000100:00100000:1.0:1788526550.102425:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.102460:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498880 00000100:00100000:1.0:1788526550.102467:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498880 00000100:00100000:1.0:1788526550.102521:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499008 00000100:00100000:1.0:1788526550.102525:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499008 00000100:00100000:1.0:1788526550.102553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499264 00000100:00100000:1.0:1788526550.102556:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499264 00000100:00100000:1.0:1788526550.102571:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526550.102579:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881498880:12345-0@lo:400: 00000100:00100000:3.0:1788526550.102826:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881498752:0@lo:8: 00000100:00100000:3.0:1788526550.102863:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.102911:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788526550.102919:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881499008:12345-0@lo:400: 00000100:00100000:3.0:1788526550.102957:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881499008:12345-0@lo:400: Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.102964:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788526550.102981:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788526550.102987:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881499264:12345-0@lo:400: 00000100:00100000:3.0:1788526550.103015:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881499264:12345-0@lo:400: Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.103021:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788526550.103050:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499136 00000100:00100000:3.0:1788526550.103055:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499136 00000100:00100000:3.0:1788526550.103083:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881498752 00000100:00100000:3.0:1788526550.103085:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881498752 00000100:00100000:3.0:1788526550.103096:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526550.103102:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881499136:12345-0@lo:400: 00000100:00100000:3.0:1788526550.103129:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881499136:12345-0@lo:400: Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.103135:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526550.103149:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526550.103153:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875405881498752:12345-0@lo:8: 00010000:00080000:3.0:1788526550.103177:0:6670:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1788526550.103209:0:6670:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3a17b 00002000:00100000:3.0:1788526550.103225:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98c27b7b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788526550.103230:0:6670:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788526550.103234:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788526550.103455:0:6670:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788526550.103651:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788526550.103685:0:6670:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526550.103737:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875405881498752:12345-0@lo:8: Request processed in 582us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.103745:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788526550.103794:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249740380 x1875405881498752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788526560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.103806:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788526550.103817:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788526550.103825:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788526550.103839:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788526550.103842:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c243185000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788526550.103852:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788526550.103858:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881498752:0@lo:8: 00000004:00080000:3.0:1788526550.103888:0:7906:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788526550.104005:0:7906:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185444617116ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788526550.104376:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249741880 x1875405881499264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.104413:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881499264:0@lo:400: 00010000:00080000:3.0:1788526550.104428:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249742d80 x1875405881499136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.104436:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881499136:0@lo:400: 00010000:00080000:3.0:1788526550.104471:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249740700 x1875405881499008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.104480:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881499008:0@lo:400: 00000100:00100000:1.0:1788526550.104655:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881498880:12345-0@lo:400: Request processed in 2075us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.104665:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788526550.104711:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526550.104717:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788526550.104795:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526550.104803:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526550.104805:0:7905:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788526550.104809:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526550.104814:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526550.104816:0:7905:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788526550.104819:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788526550.104821:0:7905:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788526550.104863:0:7905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144018a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7905:1875405881499392:0@lo:502: 00000100:00100000:1.0:1788526550.104924:0:7905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526550.104952:0:7905:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1900 going to sleep for 11 seconds 00010000:00080000:3.0:1788526550.106054:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249743480 x1875405881498880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.106069:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881498880:0@lo:400: 00000100:00100000:3.0:1788526550.106112:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499392 00000100:00100000:3.0:1788526550.106119:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499392 00000100:00100000:3.0:1788526550.106196:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788526550.106207:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:7905:x1875405881499392:12345-0@lo:502: 00000100:00100000:3.0:1788526550.107077:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:7905:x1875405881499392:12345-0@lo:502: Request processed in 868us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.107100:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788526550.107288:0:7905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144018a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:7905:1875405881499392:0@lo:502: 00000020:01000000:1.0:1788526550.107342:0:7905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526550.107349:0:7905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526550.107351:0:7905:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788526550.107356:0:7905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788526550.109130:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788526550.109146:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788526550.110275:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.110305:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526550.110407:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788526550.110410:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c248515800 from 1 10000000:01000000:2.0:1788526550.110414:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788526550.111302:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.111582:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.111604:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.111632:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881499520:0@lo:101: 00000100:00100000:2.0:1788526550.111708:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.111764:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.112064:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499520 00000100:00100000:2.0:1788526550.112073:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499520 00000100:00100000:2.0:1788526550.112132:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788526550.112142:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881499520:12345-0@lo:101: 00010000:00010000:2.0:1788526550.112156:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526550.114036:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a182 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.114080:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a182 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.114094:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a182 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.114104:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030000, rc 0) 00000100:00100000:2.0:1788526550.114207:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881499520:12345-0@lo:101: Request processed in 2066us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526550.114216:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788526550.114668:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881499520:0@lo:101: 00010000:00010000:2.0:1788526550.114690:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.114718:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526550.114782:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881499648:0@lo:501: 00000100:00100000:2.0:1788526550.114819:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526550.114857:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.114980:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499648 00000100:00100000:2.0:1788526550.114986:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499648 00000100:00100000:2.0:1788526550.115023:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788526550.115032:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881499648:12345-0@lo:501: 00000100:00100000:2.0:1788526550.115807:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881499648:12345-0@lo:501: Request processed in 771us (983us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526550.115818:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788526550.115863:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881499648:0@lo:501: 10000000:01000000:2.0:1788526550.115881:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788526550.115889:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526550.115899:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788526550.209836:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788526550.234816:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788526550.297636:0:7907:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788526550.297675:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881499904:0@lo:7: 00000100:00100000:3.0:1788526550.297750:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.297809:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c143ab3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.297843:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526550.297854:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881499776:0@lo:13: 00000100:00100000:3.0:1788526550.297879:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.297910:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499904 00000100:00100000:3.0:1788526550.297917:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499904 00000100:00100000:3.0:1788526550.297992:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526550.298002:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7907:x1875405881499904:12345-0@lo:7: 00000100:00100000:2.0:1788526550.299673:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881499776 00000100:00100000:2.0:1788526550.299689:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881499776 00000100:00100000:2.0:1788526550.299754:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526550.299764:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875405881499776:12345-0@lo:13: 00002000:00000024:2.0:1788526550.299805:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788526550.299903:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875405881499776:12345-0@lo:13: Request processed in 140us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526550.299910:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788526550.302452:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788526550.305958:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9db100 x1875405881499776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526550.305988:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881499776:0@lo:13: 00002000:00080000:3.0:1788526550.332743:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788526550.332753:0:6670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788526550.332860:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7907:x1875405881499904:12345-0@lo:7: Request processed in 34855us (35106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526550.332871:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788526550.333005:0:7907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da300 x1875405881499904/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788526566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.333022:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881499904:0@lo:7: 00000004:00080000:3.0:1788526550.333039:0:7907:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788526550.333080:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500032:0@lo:5: 00000100:00100000:3.0:1788526550.333622:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.333679:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c143ab3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.333719:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500032 00000100:00100000:3.0:1788526550.333726:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500032 00000100:00100000:3.0:1788526550.333782:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526550.333792:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7907:x1875405881500032:12345-0@lo:5: 00002000:00080000:3.0:1788526550.333822:0:6669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788526550.333825:0:6669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788526550.334639:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7907:x1875405881500032:12345-0@lo:5: Request processed in 845us (1016us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788526550.334648:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788526550.334696:0:7907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da300 x1875405881500032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788526566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526550.334712:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500032:0@lo:5: 00000004:00080000:3.0:1788526550.334722:0:7907:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788526550.334754:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500160:0@lo:700: 00000100:00100000:3.0:1788526550.334787:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.334807:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c143ab3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526550.334826:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500160 00000100:00100000:3.0:1788526550.334831:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500160 00000100:00100000:3.0:1788526550.334862:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526550.334869:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7907:x1875405881500160:12345-0@lo:700: 00000100:00100000:3.0:1788526550.334898:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1875405881500288:0@lo:700: 00000100:00100000:3.0:1788526550.334925:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.335013:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c143ab3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788526550.336466:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500288 00000100:00100000:0.0:1788526550.336544:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500288 00000100:00100000:0.0:1788526550.336594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788526550.336602:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1875405881500288:12345-0@lo:700: 40000000:02000000:1.0:1788526550.416665:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788526550.428711:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6677:x1875405881500288:12345-0@lo:700: Request processed in 92100us (93774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526550.428730:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788526550.428789:0:6677:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da680 x1875405881500288/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788526566 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526550.428804:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6677:1875405881500288:0@lo:700: 40000000:02000000:1.0:1788526550.428819:0:6677:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788526550.625459:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7907:x1875405881500160:12345-0@lo:700: Request processed in 290575us (290655us total) trans 0 rc 0/0 00000001:00080000:3.0:1788526550.625574:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788526550.625597:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788526550.625885:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788526550.626154:0:7907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9daa00 x1875405881500160/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788526566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526550.626174:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500160:0@lo:700: 00000004:02000040:2.0:1788526550.701137:0:7907:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788526550.731372:0:7907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500416:0@lo:5: 00000100:00100000:3.0:1788526550.731525:0:7907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526550.731595:0:7907:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c143ab3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788526550.731748:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500416 00000100:00100000:2.0:1788526550.731759:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500416 00000100:00100000:2.0:1788526550.731830:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526550.731839:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7907:x1875405881500416:12345-0@lo:5: 00002000:00080000:0.0:1788526550.756834:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788526550.756860:0:6669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788526550.762968:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7907:x1875405881500416:12345-0@lo:5: Request processed in 31118us (31431us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788526550.762984:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788526550.763216:0:7907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9d9f80 x1875405881500416/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788526566 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526550.763241:0:7907:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788526550.763260:0:7907:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98c26f9d9f80 x1875405881500416/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788526566 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526550.763272:0:7907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7907:1875405881500416:0@lo:5: 00000004:00080000:1.0:1788526550.763295:0:7907:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788526551.252923:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526551.511512:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526551.511553:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881500544:0@lo:13: 00000100:00100000:3.0:1788526551.511678:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526551.511765:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500544 00000100:00100000:3.0:1788526551.511775:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500544 00000100:00100000:3.0:1788526551.511834:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788526551.511844:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881500544:12345-0@lo:13: 00002000:00000024:3.0:1788526551.511891:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526551.511941:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881500544:12345-0@lo:13: Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526551.511948:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788526551.511994:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da680 x1875405881500544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526551.512016:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881500544:0@lo:13: 00000001:02000400:0.0:1788526551.872846:0:7981:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788526552.277758:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526553.310809:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526554.324555:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526555.352088:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526555.604666:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881500672:0@lo:13: 00000100:00100000:3.0:1788526555.604735:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526555.604798:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500672 00000100:00100000:3.0:1788526555.604806:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500672 00000100:00100000:3.0:1788526555.604859:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788526555.604868:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881500672:12345-0@lo:13: 00002000:00000024:3.0:1788526555.604903:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526555.604947:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881500672:12345-0@lo:13: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526555.604964:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788526555.604989:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788526555.605019:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da680 x1875405881500672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526555.605037:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881500672:0@lo:13: 00000100:00100000:0.0:1788526555.614864:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881500800:0@lo:400: 00000100:00100000:0.0:1788526555.614943:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526555.614998:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500800 00000100:00100000:0.0:1788526555.615006:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500800 00000100:00100000:0.0:1788526555.615052:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788526555.615060:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881500800:12345-0@lo:400: 00000100:00100000:0.0:1788526555.615105:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881500800:12345-0@lo:400: Request processed in 46us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526555.615112:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788526555.615160:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881500800:0@lo:400: 00000100:00100000:0.0:1788526555.615216:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881500928:0@lo:400: 00000100:00100000:0.0:1788526555.615243:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526555.615275:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881500928 00000100:00100000:0.0:1788526555.615279:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881500928 00000100:00100000:0.0:1788526555.615303:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788526555.615309:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881500928:12345-0@lo:400: 00000100:00100000:0.0:1788526555.615352:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881500928:12345-0@lo:400: Request processed in 43us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526555.615358:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788526555.615410:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2430a4000 x1875405881500928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526555.615423:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881500928:0@lo:400: 00000100:00100000:0.0:1788526555.615451:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881501056:0@lo:400: 00000100:00100000:0.0:1788526555.615473:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526555.615501:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501056 00000100:00100000:0.0:1788526555.615505:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501056 00000100:00100000:0.0:1788526555.615535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788526555.615542:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881501056:12345-0@lo:400: 00000100:00100000:0.0:1788526555.615573:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881501056:12345-0@lo:400: Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526555.615580:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788526555.615597:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526555.615617:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2430a4000 x1875405881501056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526555.615627:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881501056:0@lo:400: 00000100:00100000:0.0:1788526555.615655:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881501184:0@lo:400: 00000100:00100000:0.0:1788526555.615680:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526555.615710:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501184 00000100:00100000:0.0:1788526555.615714:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501184 00000100:00100000:0.0:1788526555.615745:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788526555.615751:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881501184:12345-0@lo:400: 00000100:00100000:0.0:1788526555.615793:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881501184:12345-0@lo:400: Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526555.615798:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788526555.615812:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788526555.615829:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2430a4000 x1875405881501184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526555.615838:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881501184:0@lo:400: 00000100:00100000:0.0:1788526555.615869:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881501312:0@lo:400: 00000100:00100000:0.0:1788526555.615890:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526555.615912:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501312 00000100:00100000:0.0:1788526555.615916:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501312 00000100:00100000:0.0:1788526555.615938:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526555.615944:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881501312:12345-0@lo:400: 00000100:00100000:0.0:1788526555.615976:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881501312:12345-0@lo:400: Request processed in 32us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526555.615982:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788526555.615995:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526555.616011:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2430a4000 x1875405881501312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526555.616021:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881501312:0@lo:400: 00000001:00080000:3.0:1788526555.740439:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788526556.371528:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526556.627674:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526556.627709:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881501440:0@lo:13: 00000100:00100000:3.0:1788526556.627790:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526556.630000:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501440 00000100:00100000:3.0:1788526556.630014:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501440 00000100:00100000:3.0:1788526556.630983:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788526556.630997:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881501440:12345-0@lo:13: 00002000:00000024:3.0:1788526556.631777:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526556.632382:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881501440:12345-0@lo:13: Request processed in 1385us (4590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526556.632416:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788526556.635688:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da680 x1875405881501440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526556.635728:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881501440:0@lo:13: 00010000:00010000:3.0:1788526557.397169:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526558.420326:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526558.525536:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.527180:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892288 00000100:00100000:0.0:1788526558.527201:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892288 00000100:00100000:0.0:1788526558.527267:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:0.0:1788526558.527276:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875405868892288:12345-192.168.204.59@tcp:250: 00010000:00080000:0.0:1788526558.527313:0:5817:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from e25535f2-071e-428f-98ae-fe60202a1364@192.168.204.59@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1788526558.527367:0:5817:0:(genops.c:1385:class_connect()) connect: client e25535f2-071e-428f-98ae-fe60202a1364, cookie 0x367645d450b3a190 00000100:00080000:2.0:1788526558.527787:0:5817:0:(import.c:65:import_set_state_nolock()) ffff98c24505c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526558.527910:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+5:2347:x1875405868892288:12345-192.168.204.59@tcp:250: Request processed in 631us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526558.527922:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:1.0:1788526558.536560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.536650:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892416 00000100:00100000:0.0:1788526558.536667:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892416 00000100:00100000:0.0:1788526558.536753:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:0.0:1788526558.536766:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+5:5577:x1875405868892416:12345-192.168.204.59@tcp:101: 00010000:00010000:0.0:1788526558.536804:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526558.536830:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5929a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.536870:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.536886:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.536899:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216c200, rc 0) 00000100:00100000:0.0:1788526558.536982:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+6:5577:x1875405868892416:12345-192.168.204.59@tcp:101: Request processed in 218us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526558.536991:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:3.0:1788526558.543672:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.544690:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892544 00000100:00100000:0.0:1788526558.544711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892544 00000100:00100000:0.0:1788526558.545532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:0.0:1788526558.545550:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+6:5577:x1875405868892544:12345-192.168.204.59@tcp:501: 00000100:00100000:0.0:1788526558.551023:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+6:5577:x1875405868892544:12345-192.168.204.59@tcp:501: Request processed in 5456us (7356us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526558.551195:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:0.0:1788526558.562151:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.562242:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892672 00000100:00100000:3.0:1788526558.562258:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892672 00000100:00100000:3.0:1788526558.562333:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:3.0:1788526558.562350:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+6:5577:x1875405868892672:12345-192.168.204.59@tcp:101: 00010000:00010000:3.0:1788526558.562413:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526558.562442:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc592a1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526558.562481:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526558.562494:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526558.562508:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54e00, rc 0) 00000100:00100000:3.0:1788526558.565306:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+7:5577:x1875405868892672:12345-192.168.204.59@tcp:101: Request processed in 2943us (3159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.565322:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:2.0:1788526558.573097:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.573253:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892800 00000100:00100000:0.0:1788526558.573266:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892800 00000100:00100000:0.0:1788526558.573334:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:0.0:1788526558.573346:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+7:5577:x1875405868892800:12345-192.168.204.59@tcp:501: 00000100:00100000:0.0:1788526558.573881:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+8:5577:x1875405868892800:12345-192.168.204.59@tcp:501: Request processed in 536us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526558.573890:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:1.0:1788526558.583293:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.583456:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868892928 00000100:00100000:3.0:1788526558.583474:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868892928 00000100:00100000:3.0:1788526558.583564:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:3.0:1788526558.583579:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+8:5577:x1875405868892928:12345-192.168.204.59@tcp:503: 00000100:00100000:3.0:1788526558.584927:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+8:5577:x1875405868892928:12345-192.168.204.59@tcp:503: Request processed in 1343us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.584941:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:1.0:1788526558.589179:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.589342:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893056 00000100:00100000:3.0:1788526558.589360:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893056 00000100:00100000:3.0:1788526558.589508:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:3.0:1788526558.589523:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:5595:x1875405868893056:12345-192.168.204.59@tcp:502: 00000100:00100000:3.0:1788526558.590044:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:5595:x1875405868893056:12345-192.168.204.59@tcp:502: Request processed in 523us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.590063:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:2.0:1788526558.642224:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.644016:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893184 00000100:00100000:3.0:1788526558.644037:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893184 00000100:00100000:3.0:1788526558.644116:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:3.0:1788526558.644142:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+8:5595:x1875405868893184:12345-192.168.204.59@tcp:502: 00000100:00100000:3.0:1788526558.644584:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+8:5595:x1875405868893184:12345-192.168.204.59@tcp:502: Request processed in 455us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.644594:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1788526558.653266:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.653370:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893312 00000100:00100000:0.0:1788526558.653384:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893312 00000100:00100000:0.0:1788526558.653479:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1788526558.653492:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:5577:x1875405868893312:12345-192.168.204.59@tcp:101: 00010000:00010000:0.0:1788526558.653517:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526558.653541:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c28216d200/0x367645d450b3a1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc592cb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.653579:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c28216d200/0x367645d450b3a1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592cb expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.653592:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c28216d200/0x367645d450b3a1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592cb expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526558.653604:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216d200, rc 0) 00000100:00100000:0.0:1788526558.653678:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+9:5577:x1875405868893312:12345-192.168.204.59@tcp:101: Request processed in 188us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526558.653685:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1788526558.663666:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526558.664271:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893440 00000100:00100000:1.0:1788526558.664286:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893440 00000100:00100000:1.0:1788526558.664359:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:1.0:1788526558.664374:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+9:5577:x1875405868893440:12345-192.168.204.59@tcp:256: 20000000:01000000:1.0:1788526558.664582:0:5818:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788526558.664618:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788526558.664623:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788526558.664627:0:5818:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788526558.664630:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788526558.677369:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+9:5577:x1875405868893440:12345-192.168.204.59@tcp:256: Request processed in 12981us (13702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526558.677411:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1788526558.685406:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526558.685581:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893568 00000100:00100000:1.0:1788526558.685597:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893568 00000100:00100000:1.0:1788526558.685666:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:1.0:1788526558.685686:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:5577:x1875405868893568:12345-192.168.204.59@tcp:101: 00010000:00010000:1.0:1788526558.685710:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526558.685736:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc592d2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526558.685790:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526558.685808:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526558.685846:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241662200, rc 0) 00000100:00100000:1.0:1788526558.685954:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5577:x1875405868893568:12345-192.168.204.59@tcp:101: Request processed in 270us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526558.685963:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:2.0:1788526558.694018:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526558.694152:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893696 00000100:00100000:0.0:1788526558.694169:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893696 00000100:00100000:0.0:1788526558.694466:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:0.0:1788526558.694478:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:5577:x1875405868893696:12345-192.168.204.59@tcp:501: 00000100:00100000:0.0:1788526558.694895:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:5577:x1875405868893696:12345-192.168.204.59@tcp:501: Request processed in 417us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526558.694906:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:1.0:1788526558.700906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.701057:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893824 00000100:00100000:3.0:1788526558.701074:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893824 00000100:00100000:3.0:1788526558.701156:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:3.0:1788526558.701169:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5577:x1875405868893824:12345-192.168.204.59@tcp:503: 00000100:00100000:3.0:1788526558.701841:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5577:x1875405868893824:12345-192.168.204.59@tcp:503: Request processed in 669us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.701850:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:2.0:1788526558.716019:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526558.717921:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868893952 00000100:00100000:3.0:1788526558.717945:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868893952 00000100:00100000:3.0:1788526558.718022:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:3.0:1788526558.718034:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:5601:x1875405868893952:12345-192.168.204.59@tcp:502: 00000100:00100000:3.0:1788526558.718668:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:5601:x1875405868893952:12345-192.168.204.59@tcp:502: Request processed in 630us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526558.718679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1788526558.732383:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526558.732565:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894080 00000100:00100000:1.0:1788526558.732583:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894080 00000100:00100000:1.0:1788526558.732671:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:1.0:1788526558.732684:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5601:x1875405868894080:12345-192.168.204.59@tcp:502: 00000100:00100000:1.0:1788526558.733017:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5601:x1875405868894080:12345-192.168.204.59@tcp:502: Request processed in 335us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526558.733026:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:0.0:1788526558.745102:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526558.745238:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894208 00000100:00100000:1.0:1788526558.745251:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894208 00000100:00100000:1.0:1788526558.745319:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1788526558.745330:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875405868894208:12345-192.168.204.59@tcp:38: 00010000:00080000:1.0:1788526558.745374:0:5823:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1788526558.745466:0:5823:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a1b3 00000004:00100000:1.0:1788526558.745513:0:5823:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788526558.745521:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788526558.798311:0:5823:0:(import.c:65:import_set_state_nolock()) ffff98c144017800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526558.798478:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868894208:12345-192.168.204.59@tcp:38: Request processed in 53145us (53392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526558.798492:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00010000:00010000:3.0:1788526559.444817:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526559.804728:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526559.804793:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526559.805613:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894464 00000100:00100000:2.0:1788526559.805649:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894464 00000100:00080000:1.0:1788526559.805850:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526559.805887:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894336 00000100:00100000:2.0:1788526559.805892:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894336 00000100:00100000:2.0:1788526559.805932:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526559.805947:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:5577:x1875405868894464:12345-192.168.204.59@tcp:41: 00000004:00000024:2.0:1788526559.806011:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788526559.806125:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1788526559.806136:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:0:x1875405868894336:12345-192.168.204.59@tcp:41: 00000004:00000024:1.0:1788526559.806154:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788526559.806268:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:0:x1875405868894336:12345-192.168.204.59@tcp:41: Request processed in 135us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526559.806276:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1788526559.808611:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:5577:x1875405868894464:12345-192.168.204.59@tcp:41: Request processed in 2649us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526559.808629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1788526559.812531:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526559.812674:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894592 00000100:00100000:0.0:1788526559.812689:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894592 00000100:00100000:0.0:1788526559.812868:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1788526559.812884:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:5577:x1875405868894592:12345-192.168.204.59@tcp:40: 00000100:00100000:0.0:1788526559.813123:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:5577:x1875405868894592:12345-192.168.204.59@tcp:40: Request processed in 241us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526559.813133:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526559.819114:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526559.819234:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526559.819265:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526559.819316:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526559.819426:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894720 00000100:00100000:3.0:1788526559.819440:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894720 00000100:00100000:3.0:1788526559.819511:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894848 00000100:00100000:3.0:1788526559.819515:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894848 00000100:00100000:3.0:1788526559.819535:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526559.819548:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405868894720:12345-192.168.204.59@tcp:8: 00010000:00080000:3.0:1788526559.819603:0:6669:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1788526559.819644:0:6669:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a1ba 00002000:00100000:3.0:1788526559.819661:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f122900d-e71c-4fc3-b559-b19040da7c34/ffff98c27b7b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788526559.819697:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788526559.820477:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788526559.820526:0:6669:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526559.820637:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868894720:12345-192.168.204.59@tcp:8: Request processed in 1089us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526559.820646:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526559.820683:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1788526559.820690:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405868894848:12345-192.168.204.59@tcp:8: 00010000:00080000:3.0:1788526559.820712:0:6669:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:3.0:1788526559.820735:0:6669:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a1c1 00002000:00100000:3.0:1788526559.820742:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f122900d-e71c-4fc3-b559-b19040da7c34/ffff98c27b7b5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788526559.820900:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788526559.821192:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895104 00000100:00100000:2.0:1788526559.821202:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895104 00000100:00100000:2.0:1788526559.821263:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:2.0:1788526559.821272:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868895104:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1788526559.821313:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868895104:12345-192.168.204.59@tcp:400: Request processed in 44us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526559.821319:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00002000:00080000:3.0:1788526559.823327:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788526559.823411:0:6669:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526559.826954:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868894848:12345-192.168.204.59@tcp:8: Request processed in 6239us (7664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526559.826976:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526559.827724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868894976 00000100:00100000:0.0:1788526559.827742:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868894976 00000100:00100000:0.0:1788526559.830643:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1788526559.830660:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:5577:x1875405868894976:12345-192.168.204.59@tcp:33: 00000004:00080000:1.0:1788526559.868764:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37997us 00000004:00200000:0.0:1788526559.901468:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788526559.901644:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:5577:x1875405868894976:12345-192.168.204.59@tcp:33: Request processed in 70978us (82609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526559.901657:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1788526560.072248:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526560.072376:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895232 00000100:00100000:0.0:1788526560.072424:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895232 00000100:00100000:0.0:1788526560.072518:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1788526560.072532:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:5619:x1875405868895232:12345-192.168.204.59@tcp:101: 00010000:00010000:0.0:1788526560.072588:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526560.072927:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c000/0x367645d450b3a1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc592fc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073046:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073065:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073081:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526560.073131:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526560.073135:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526560.073154:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073186:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c000/0x367645d450b3a1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592fc expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073213:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592fc expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526560.073222:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972600) 00010000:00010000:0.0:1788526560.073226:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526560.073230:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216cc00, rc 0) 00000100:00100000:0.0:1788526560.073321:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:5619:x1875405868895232:12345-192.168.204.59@tcp:101: Request processed in 791us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526560.073331:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00010000:00010000:0.0:1788526560.467763:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526560.723689:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526560.723841:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526560.723842:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881501696:0@lo:400: 00000100:00100000:1.0:1788526560.723857:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881501952:0@lo:400: 00000100:00100000:0.0:1788526560.724532:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526560.724606:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526560.724615:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881501824:0@lo:400: 00000100:00100000:0.0:1788526560.724656:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526560.724704:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501696 00000100:00100000:0.0:1788526560.724716:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501696 00000100:00100000:0.0:1788526560.724862:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788526560.724874:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881501696:12345-0@lo:400: 00000100:00100000:0.0:1788526560.725765:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881501696:12345-0@lo:400: Request processed in 888us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526560.725852:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788526560.725945:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881501696:0@lo:400: 00000100:00100000:2.0:1788526560.727770:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881501568:0@lo:13: 00000100:00100000:2.0:1788526560.727860:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526560.728273:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501824 00000100:00100000:2.0:1788526560.728289:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501824 00000100:00100000:2.0:1788526560.728366:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526560.728378:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881501824:12345-0@lo:400: 00000100:00100000:2.0:1788526560.728553:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881501824:12345-0@lo:400: Request processed in 176us (3895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526560.728562:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526560.728671:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881501824:0@lo:400: 00000100:00100000:2.0:1788526560.728711:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501568 00000100:00100000:2.0:1788526560.728714:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501568 00000100:00100000:1.0:1788526560.728851:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526560.728887:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881501952 00000100:00100000:1.0:1788526560.728891:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881501952 00000100:00100000:3.0:1788526560.729026:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881502208:0@lo:400: 00000100:00100000:3.0:1788526560.729071:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526560.729114:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526560.729121:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881502080:0@lo:400: 00000100:00100000:3.0:1788526560.729149:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526560.729178:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502080 00000100:00100000:3.0:1788526560.729182:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502080 00000100:00100000:2.0:1788526560.729241:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526560.729249:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881501568:12345-0@lo:13: 00002000:00000024:2.0:1788526560.729270:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526560.729313:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881501568:12345-0@lo:13: Request processed in 65us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526560.729319:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788526560.729379:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26f9da680 x1875405881501568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526560.729411:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788526560.729433:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881501568:0@lo:13: 00000100:00100000:0.0:1788526560.729672:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502208 00000100:00100000:0.0:1788526560.729677:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502208 00000100:00100000:3.0:1788526560.733299:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788526560.734757:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881502080:12345-0@lo:400: 00000100:00100000:1.0:1788526560.736850:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788526560.736882:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881501952:12345-0@lo:400: 00000100:00080000:2.0:1788526560.737203:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526560.737211:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526560.737215:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788526560.738150:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788526560.738163:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881502208:12345-0@lo:400: 00000100:00100000:1.0:1788526560.743280:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881501952:12345-0@lo:400: Request processed in 6401us (14415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526560.743303:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788526560.743418:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881501952:0@lo:400: 00000100:00100000:3.0:1788526560.746633:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881502080:12345-0@lo:400: Request processed in 13303us (17466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526560.746653:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788526560.746749:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249741880 x1875405881502080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526560.746769:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881502080:0@lo:400: 00000100:00100000:1.0:1788526560.755305:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881502208:12345-0@lo:400: Request processed in 16986us (26074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526560.755328:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788526560.755460:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881502208:0@lo:400: 00000001:00100000:1.0:1788526560.811775:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00010000:00010000:3.0:1788526561.491695:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526561.747709:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881502336:0@lo:13: 00000100:00100000:2.0:1788526561.747819:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526561.750333:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502336 00000100:00100000:3.0:1788526561.750352:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502336 00000100:00100000:3.0:1788526561.750455:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788526561.750467:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881502336:12345-0@lo:13: 00002000:00000024:3.0:1788526561.750523:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526561.750650:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881502336:12345-0@lo:13: Request processed in 184us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526561.750658:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788526561.750811:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249741880 x1875405881502336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526561.750836:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881502336:0@lo:13: 00000100:00100000:2.0:1788526562.197358:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526562.197600:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895360 00000100:00100000:0.0:1788526562.197623:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895360 00000100:00100000:0.0:1788526562.197708:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526562.197719:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:5671:x1875405868895360:12345-192.168.204.59@tcp:41: 00000004:00000024:0.0:1788526562.197778:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788526562.197888:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:5671:x1875405868895360:12345-192.168.204.59@tcp:41: Request processed in 170us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526562.197895:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:2.0:1788526562.198145:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526562.202652:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526562.202821:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895488 00000100:00100000:3.0:1788526562.202838:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895488 00000100:00100000:3.0:1788526562.203015:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1788526562.203029:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f122900d-e71c-4fc3-b559-b19040da7c34+5:5671:x1875405868895488:12345-192.168.204.59@tcp:13: 00002000:00000024:3.0:1788526562.203093:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526562.203195:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f122900d-e71c-4fc3-b559-b19040da7c34+5:5671:x1875405868895488:12345-192.168.204.59@tcp:13: Request processed in 168us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526562.203204:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00080000:2.0:1788526562.208797:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526562.214378:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526562.214514:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895616 00000100:00100000:3.0:1788526562.214528:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895616 00000100:00100000:3.0:1788526562.214624:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526562.214636:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f122900d-e71c-4fc3-b559-b19040da7c34+6:5671:x1875405868895616:12345-192.168.204.59@tcp:13: 00002000:00000024:3.0:1788526562.214691:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526562.214789:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f122900d-e71c-4fc3-b559-b19040da7c34+6:5671:x1875405868895616:12345-192.168.204.59@tcp:13: Request processed in 155us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526562.214798:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00080000:2.0:1788526562.215666:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788526562.516524:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526563.539616:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788526563.933500:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00010000:00010000:3.0:1788526564.566702:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788526564.930366:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000100:00100000:1.0:1788526565.017450:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526565.017503:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526565.017537:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526565.017569:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526565.017745:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895872 00000100:00100000:1.0:1788526565.017758:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895872 00000100:00100000:1.0:1788526565.017845:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1788526565.017860:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868895872:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1788526565.017965:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868895872:12345-192.168.204.59@tcp:400: Request processed in 109us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526565.017974:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1788526565.018014:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896000 00000100:00100000:1.0:1788526565.018018:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896000 00000100:00100000:1.0:1788526565.018046:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896128 00000100:00100000:1.0:1788526565.018048:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896128 00000100:00100000:1.0:1788526565.018067:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1788526565.018074:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896000:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1788526565.018127:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896000:12345-192.168.204.59@tcp:400: Request processed in 53us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526565.018135:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1788526565.018149:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526565.018155:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896128:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1788526565.018180:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896128:12345-192.168.204.59@tcp:400: Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526565.018187:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00080000:1.0:1788526565.018206:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526565.018211:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526565.018214:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526565.018620:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868895744 00000100:00100000:2.0:1788526565.018635:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868895744 00000100:00100000:2.0:1788526565.018707:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:2.0:1788526565.018720:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868895744:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1788526565.018834:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868895744:12345-192.168.204.59@tcp:400: Request processed in 116us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.018842:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000001:02000400:2.0:1788526565.443808:0:8287:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788526565.587584:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526565.846511:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881502592:0@lo:400: 00000100:00100000:0.0:1788526565.846612:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.846622:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881502464:0@lo:400: 00000100:00100000:1.0:1788526565.846685:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881502720:0@lo:400: 00000100:00100000:3.0:1788526565.846808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502592 00000100:00100000:3.0:1788526565.846820:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502592 00000100:00100000:3.0:1788526565.846891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526565.846903:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881502592:12345-0@lo:400: 00000100:00100000:2.0:1788526565.850358:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.851738:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881502976:0@lo:400: 00000100:00100000:2.0:1788526565.851846:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.851897:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526565.851906:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881503104:0@lo:400: 00000100:00100000:2.0:1788526565.851935:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.852013:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502464 00000100:00100000:2.0:1788526565.852025:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502464 00000100:00100000:2.0:1788526565.852087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788526565.852097:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881502464:12345-0@lo:400: 00000100:00100000:2.0:1788526565.852163:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881502464:12345-0@lo:400: Request processed in 67us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.852171:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788526565.852234:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881502464:0@lo:400: 00000100:00100000:2.0:1788526565.852286:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502976 00000100:00100000:2.0:1788526565.852290:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502976 00000100:00100000:2.0:1788526565.852330:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788526565.852338:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881502976:12345-0@lo:400: 00000100:00100000:2.0:1788526565.852375:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881502976:12345-0@lo:400: Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.852381:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788526565.852462:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881502848:0@lo:400: 00000100:00100000:2.0:1788526565.852493:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.852531:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526565.852539:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881503232:0@lo:13: 00000100:00100000:2.0:1788526565.852564:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526565.852601:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881502976:0@lo:400: 00000100:00100000:2.0:1788526565.852629:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881503104 00000100:00100000:2.0:1788526565.852633:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881503104 00000100:00100000:2.0:1788526565.852663:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502848 00000100:00100000:2.0:1788526565.852667:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502848 00000100:00100000:2.0:1788526565.852686:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526565.852693:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881503104:12345-0@lo:400: 00000100:00100000:2.0:1788526565.852733:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881503104:12345-0@lo:400: Request processed in 41us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.852739:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526565.852751:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526565.852757:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881502848:12345-0@lo:400: 00000100:00100000:2.0:1788526565.852788:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881502848:12345-0@lo:400: Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.852795:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788526565.852822:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245222d80 x1875405881502848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526565.852834:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881502848:0@lo:400: 00010000:00080000:2.0:1788526565.852857:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220e00 x1875405881503104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526565.852866:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881503104:0@lo:400: 00000100:00100000:2.0:1788526565.852900:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881503232 00000100:00100000:2.0:1788526565.852904:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881503232 00000100:00100000:2.0:1788526565.852932:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526565.852939:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881503232:12345-0@lo:13: 00002000:00000024:2.0:1788526565.852975:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526565.853026:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881503232:12345-0@lo:13: Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526565.853032:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788526565.853059:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249741880 x1875405881503232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526565.853076:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881503232:0@lo:13: 00000100:00080000:2.0:1788526565.853117:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526565.853122:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526565.853125:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526565.859841:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526565.864073:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881502592:12345-0@lo:400: Request processed in 17153us (17442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526565.864097:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526565.864529:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881502592:0@lo:400: 00000100:00100000:3.0:1788526565.864574:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881502720 00000100:00100000:3.0:1788526565.864583:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881502720 00000100:00080000:3.0:1788526565.864629:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526565.864710:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788526565.864721:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881502720:12345-0@lo:400: 00000100:00100000:3.0:1788526565.865048:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881502720:12345-0@lo:400: Request processed in 328us (5219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526565.865056:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788526565.865247:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881502720:0@lo:400: 00010000:00010000:1.0:1788526566.619404:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526566.868168:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526566.868211:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881503360:0@lo:13: 00000100:00100000:1.0:1788526566.868314:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526566.868579:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881503360 00000100:00100000:2.0:1788526566.868596:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881503360 00000100:00100000:2.0:1788526566.868670:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526566.868682:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881503360:12345-0@lo:13: 00002000:00000024:2.0:1788526566.868725:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526566.868826:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881503360:12345-0@lo:13: Request processed in 147us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526566.868834:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788526566.868986:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245223b80 x1875405881503360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526566.869015:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881503360:0@lo:13: 00010000:00010000:2.0:1788526567.635889:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526568.659899:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788526569.459894:0:8434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf49b9690 20000000:00000080:0.0:1788526569.459943:0:8434:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c27b537400 uarg=0000000000000000 20000000:01000000:0.0:1788526569.460152:0:8434:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788526569.460156:0:8434:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788526569.460159:0:8434:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788526569.460166:0:8434:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788526569.460173:0:8434:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788526569.460195:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788526569.460199:0:8434:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788526569.462355:0:8434:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788526569.462365:0:8434:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788526569.470519:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788526569.481188:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788526569.481362:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788526569.482252:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788526569.482287:0:8434:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788526569.482291:0:8434:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788526569.497982:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788526569.503529:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788526569.503818:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788526569.503865:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788526569.503891:0:8434:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788526569.503895:0:8434:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788526569.513746:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788526569.520902:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788526569.520993:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788526569.522381:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788526569.522674:0:8434:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788526569.522677:0:8434:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788526569.531000:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788526569.539659:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788526569.539764:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788526569.539806:0:8434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1788526569.539826:0:8434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788526569.539853:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539887:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539896:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0be expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539903:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539909:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a112 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539929:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a120 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539937:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a12e expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539944:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a13c expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539952:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a158 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539958:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a182 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539968:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539987:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.539996:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540302:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540326:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 9 pid: 5818 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540345:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503488:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526569.540653:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540662:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 9 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540672:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503616:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526569.540710:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540719:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 20 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540728:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503744:0@lo:104: 00000100:00100000:0.0:1788526569.540783:0:8434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526569.540840:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540849:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 20 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540857:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503872:0@lo:104: 00010000:00010000:0.0:1788526569.540883:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540890:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 20 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540898:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504000:0@lo:104: 00010000:00010000:0.0:1788526569.540937:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540944:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 20 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540952:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504128:0@lo:104: 00010000:00010000:0.0:1788526569.540978:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.540986:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 20 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.540994:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504256:0@lo:104: 00010000:00010000:0.0:1788526569.541028:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.541059:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 20 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.541067:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504384:0@lo:104: 00010000:00010000:0.0:1788526569.541097:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.541105:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 20 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.541112:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504512:0@lo:104: 00010000:00010000:0.0:1788526569.541135:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.541142:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 20 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.541148:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504640:0@lo:104: 00010000:00010000:0.0:1788526569.541167:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.541174:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 20 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526569.541180:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504768:0@lo:104: 00000100:00100000:0.0:1788526569.541197:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526569.541623:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788526569.541658:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541696:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541708:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541716:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541726:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541735:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541745:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541756:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881503744 00000100:00100000:2.0:1788526569.541766:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881503744 00000100:00100000:2.0:1788526569.541823:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:2.0:1788526569.541838:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.541846:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881503872 00000100:00100000:2.0:1788526569.541849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881503872 00000100:00100000:2.0:1788526569.541862:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504000 00000100:00100000:2.0:1788526569.541865:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504000 00000100:00100000:2.0:1788526569.541872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504128 00000100:00100000:2.0:1788526569.541874:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504128 00000100:00100000:2.0:1788526569.541881:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504256 00000100:00100000:2.0:1788526569.541883:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504256 00000100:00100000:2.0:1788526569.541890:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504384 00000100:00100000:2.0:1788526569.541892:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504384 00000100:00100000:2.0:1788526569.541900:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504512 00000100:00100000:2.0:1788526569.541902:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504512 00000100:00100000:2.0:1788526569.541910:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504640 00000100:00100000:2.0:1788526569.541912:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504640 00000100:00100000:2.0:1788526569.541936:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504768 00000100:00100000:2.0:1788526569.541939:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504768 00000100:00100000:2.0:1788526569.541954:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526569.541964:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27bbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:8434:x1875405881503744:12345-0@lo:104: 00010000:00010000:2.0:1788526569.541984:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542089:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526569.542097:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27bbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+11:8434:x1875405881503744:12345-0@lo:104: Request processed in 134us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542105:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526569.542152:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526569.542159:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:8434:x1875405881503872:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542168:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542203:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788526569.542209:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+10:8434:x1875405881503872:12345-0@lo:104: Request processed in 51us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542214:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526569.542227:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526569.542233:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:8434:x1875405881504000:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542242:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542278:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788526569.542283:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+9:8434:x1875405881504000:12345-0@lo:104: Request processed in 51us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542289:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526569.542299:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788526569.542305:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:8434:x1875405881504128:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542312:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542351:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788526569.542357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+8:8434:x1875405881504128:12345-0@lo:104: Request processed in 53us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788526569.542374:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788526569.542379:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:8434:x1875405881504256:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542437:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542464:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788526569.542470:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+7:8434:x1875405881504256:12345-0@lo:104: Request processed in 91us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542476:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788526569.542487:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788526569.542493:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:8434:x1875405881504384:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542500:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542526:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788526569.542531:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+6:8434:x1875405881504384:12345-0@lo:104: Request processed in 39us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542537:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788526569.542547:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788526569.542552:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:8434:x1875405881504512:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542560:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542595:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788526569.542600:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:8434:x1875405881504512:12345-0@lo:104: Request processed in 49us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542607:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788526569.542619:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788526569.542625:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:8434:x1875405881504640:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542632:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542661:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788526569.542666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:8434:x1875405881504640:12345-0@lo:104: Request processed in 42us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542671:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788526569.542692:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788526569.542699:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8434:x1875405881504768:12345-0@lo:104: 00010000:00010000:2.0:1788526569.542708:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542735:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788526569.542741:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8434:x1875405881504768:12345-0@lo:104: Request processed in 43us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526569.542746:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788526569.542769:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788526569.542776:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542784:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.542796:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542809:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.542816:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.542823:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.542865:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542872:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.542902:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542909:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a189 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542943:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788526569.542946:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542953:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.542956:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.542963:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.542984:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.542990:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543006:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543013:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543019:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543026:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a15f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543037:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788526569.543040:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543047:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282045200 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543050:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543057:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543065:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543071:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543095:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543101:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543121:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543129:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282045200/0x367645d450b3a13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a143 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543141:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788526569.543145:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543151:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543154:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543162:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543168:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543173:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543187:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543194:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543199:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543222:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282044e00/0x367645d450b3a12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a135 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543235:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788526569.543238:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543245:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543248:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543255:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543263:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543269:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543285:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543292:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543297:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543304:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b55800/0x367645d450b3a120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a127 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543315:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788526569.543326:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543333:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543336:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543344:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543350:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543356:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543372:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543379:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543383:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543423:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662800/0x367645d450b3a112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a119 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543435:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788526569.543438:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543445:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54000 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543447:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543466:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543473:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543479:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543495:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543502:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543507:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543515:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b54000/0x367645d450b3a0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0ef expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543526:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526569.543530:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543537:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282045e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543540:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543547:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543554:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543565:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543582:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543589:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543593:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543601:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282045e00/0x367645d450b3a0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0c5 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543613:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526569.543617:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543623:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526569.543626:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543634:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526569.543640:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526569.543646:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526569.543680:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543687:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526569.543699:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543706:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b55a00/0x367645d450b3a0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0b7 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.543725:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526569.543727:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526569.543729:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526569.543742:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526569.543748:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526569.543756:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526569.543811:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881504896:0@lo:103: 00000100:00100000:2.0:1788526569.543884:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.543948:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505408:0@lo:103: 00000100:00100000:2.0:1788526569.543969:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.543995:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505920:0@lo:103: 00000100:00100000:2.0:1788526569.544012:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544037:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788526569.544043:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505024:0@lo:103: 00000100:00100000:2.0:1788526569.544062:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544071:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505536:0@lo:103: 00000100:00100000:2.0:1788526569.544109:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544136:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505152:0@lo:103: 00000100:00100000:2.0:1788526569.544164:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544175:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505664:0@lo:103: 00000100:00100000:2.0:1788526569.544195:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544218:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526569.544224:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505280:0@lo:103: 00000100:00100000:2.0:1788526569.544248:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526569.544258:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505792:0@lo:103: 00000100:00100000:2.0:1788526569.544276:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526569.544783:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503744:0@lo:104: 00000100:00100000:0.0:1788526569.544797:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503872:0@lo:104: 00000100:00100000:0.0:1788526569.544819:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504000:0@lo:104: 00000100:00100000:0.0:1788526569.544829:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504128:0@lo:104: 00000100:00100000:0.0:1788526569.544838:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504256:0@lo:104: 00000100:00100000:0.0:1788526569.544847:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504384:0@lo:104: 00000100:00100000:0.0:1788526569.544856:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504512:0@lo:104: 00000100:00100000:0.0:1788526569.544865:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504640:0@lo:104: 00000100:00100000:0.0:1788526569.544875:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881504768:0@lo:104: 00000100:00100000:3.0:1788526569.545057:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881504896 00000100:00100000:3.0:1788526569.545068:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881504896 00010000:00010000:3.0:1788526569.545118:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 21 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545147:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505408 00000100:00100000:3.0:1788526569.545151:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505408 00010000:00010000:3.0:1788526569.545164:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 22 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545174:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505920 00000100:00100000:3.0:1788526569.545176:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505920 00010000:00010000:3.0:1788526569.545186:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 23 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545196:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505024 00000100:00100000:3.0:1788526569.545198:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505024 00010000:00010000:3.0:1788526569.545210:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 24 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545241:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505536 00000100:00100000:3.0:1788526569.545245:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505536 00010000:00010000:3.0:1788526569.545259:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 25 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545269:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505152 00000100:00100000:3.0:1788526569.545272:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505152 00010000:00010000:3.0:1788526569.545282:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 26 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545293:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505664 00000100:00100000:3.0:1788526569.545295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505664 00010000:00010000:3.0:1788526569.545307:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 27 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545317:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505280 00000100:00100000:3.0:1788526569.545320:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505280 00010000:00010000:3.0:1788526569.545331:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 28 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545340:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881505792 00000100:00100000:3.0:1788526569.545343:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881505792 00010000:00010000:3.0:1788526569.545354:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 29 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526569.545368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788526569.545377:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2493a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+29:3280:x1875405881504896:12345-0@lo:103: 00010000:00010000:3.0:1788526569.545419:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.545425:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 29 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545446:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 29 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545469:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030000/0x367645d450b3a189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a182 expref: 29 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545486:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.545753:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2493a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+28:3280:x1875405881504896:12345-0@lo:103: Request processed in 182us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.545763:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788526569.545829:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526569.545837:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+27:3280:x1875405881505408:12345-0@lo:103: 00010000:00010000:3.0:1788526569.545845:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.545850:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 27 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545859:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 27 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545871:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044600/0x367645d450b3a127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a120 expref: 27 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545882:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.545906:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+26:3280:x1875405881505408:12345-0@lo:103: Request processed in 70us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.545911:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526569.545938:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788526569.545945:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+25:3280:x1875405881505920:12345-0@lo:103: 00010000:00010000:3.0:1788526569.545960:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.545966:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 25 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545974:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 25 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545984:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045c00/0x367645d450b3a0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a0b0 expref: 25 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.545994:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.546124:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+24:3280:x1875405881505920:12345-0@lo:103: Request processed in 179us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.546131:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788526569.546146:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788526569.546152:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+23:3280:x1875405881505024:12345-0@lo:103: 00010000:00010000:3.0:1788526569.546160:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.546166:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 23 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546175:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 23 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546186:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55400/0x367645d450b3a15f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a158 expref: 23 pid: 5815 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546195:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.546217:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+22:3280:x1875405881505024:12345-0@lo:103: Request processed in 65us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.546233:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788526569.546246:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526569.546252:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881505536:12345-0@lo:103: 00010000:00010000:3.0:1788526569.546260:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.546264:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 21 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546273:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 21 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546283:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55000/0x367645d450b3a119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a112 expref: 21 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546292:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.546316:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3280:x1875405881505536:12345-0@lo:103: Request processed in 64us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.546322:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526569.546335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788526569.546341:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3278:x1875405881505152:12345-0@lo:103: 00010000:00010000:3.0:1788526569.546349:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.546354:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 19 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546363:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 19 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546373:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55c00/0x367645d450b3a143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a13c expref: 19 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546440:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.546482:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3278:x1875405881505152:12345-0@lo:103: Request processed in 140us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.546488:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788526569.546503:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788526569.546510:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3278:x1875405881505664:12345-0@lo:103: 00010000:00010000:3.0:1788526569.546518:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.546523:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 17 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546532:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 17 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546542:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045800/0x367645d450b3a0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a0e8 expref: 17 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.546552:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.548287:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:3278:x1875405881505664:12345-0@lo:103: Request processed in 1764us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.548305:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788526569.548352:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788526569.548365:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2493a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:3278:x1875405881505280:12345-0@lo:103: 00010000:00010000:3.0:1788526569.548400:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526569.548410:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 15 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.548426:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 15 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.548468:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241663400/0x367645d450b3a135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a12e expref: 15 pid: 5817 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526569.548489:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526569.548526:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2493a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:3278:x1875405881505280:12345-0@lo:103: Request processed in 167us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526569.548534:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788526569.548747:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505024:0@lo:103: 00000100:00100000:0.0:1788526569.548763:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505536:0@lo:103: 00000100:00100000:0.0:1788526569.548774:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881504896:0@lo:103: 00000100:00100000:0.0:1788526569.548783:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505408:0@lo:103: 00000100:00100000:0.0:1788526569.548792:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881505920:0@lo:103: 00000100:00100000:0.0:1788526569.549779:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788526569.549799:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:3278:x1875405881505792:12345-0@lo:103: 00010000:00010000:0.0:1788526569.549816:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526569.549824:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 13 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.549837:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 13 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.549855:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54600/0x367645d450b3a0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a0be expref: 13 pid: 5818 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526569.549887:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526569.549960:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3278:x1875405881505792:12345-0@lo:103: Request processed in 170us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526569.549968:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788526569.555307:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505280:0@lo:103: 00000100:00100000:3.0:1788526569.555331:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505792:0@lo:103: 00000100:00100000:3.0:1788526569.555344:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505152:0@lo:103: 00000100:00100000:3.0:1788526569.555354:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881505664:0@lo:103: 00000100:00100000:1.0:1788526569.556527:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526569.556575:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526569.556609:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896256 00000100:00100000:1.0:1788526569.556619:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896256 00010000:00010000:1.0:1788526569.556675:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 10 pid: 5818 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526569.556710:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896384 00000100:00100000:1.0:1788526569.556731:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896384 00010000:00010000:1.0:1788526569.556747:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 11 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526569.556765:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1788526569.556776:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+11:2348:x1875405868896256:12345-192.168.204.59@tcp:103: 00010000:00010000:1.0:1788526569.556795:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526569.556803:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 11 pid: 5818 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.556818:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 11 pid: 5818 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.556845:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526569.556930:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+11:2348:x1875405868896256:12345-192.168.204.59@tcp:103: Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526569.556938:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1788526569.556957:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1788526569.556964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868896384:12345-192.168.204.59@tcp:103: 00010000:00010000:1.0:1788526569.556971:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526569.556975:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 10 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.556984:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 10 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.556999:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557048:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557067:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557075:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557081:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557089:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557095:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216de00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526569.557100:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557109:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557119:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526569.557131:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526569.557152:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868896384:12345-192.168.204.59@tcp:103: Request processed in 188us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526569.557159:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00010000:00010000:2.0:1788526569.558362:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54e00/0x367645d450b3a19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592a1 expref: 9 pid: 5818 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526569.558383:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503488:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526569.558427:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c28216c200/0x367645d450b3a197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5929a expref: 8 pid: 5815 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526569.558436:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8434:1875405881503616:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526569.558497:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.558507:0:8434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.558513:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.558519:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c28216de00/0x367645d450b3a1d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526569.689445:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526570.141045:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526570.141118:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526570.141157:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526570.141174:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896512 00000100:00100000:0.0:1788526570.141188:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896512 00000100:00100000:1.0:1788526570.141200:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526570.141225:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896768 00000100:00100000:1.0:1788526570.141229:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896768 00000100:00100000:0.0:1788526570.141255:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:0.0:1788526570.141267:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:2350:x1875405868896512:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1788526570.141268:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896896 00000100:00100000:1.0:1788526570.141270:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896896 00000100:00100000:1.0:1788526570.141285:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1788526570.141292:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896768:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1788526570.141426:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788526570.141440:0:6669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788526570.141461:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788526570.141471:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1788526570.141487:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896896:12345-192.168.204.59@tcp:400: 00000100:00100000:0.0:1788526570.141607:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:2350:x1875405868896512:12345-192.168.204.59@tcp:400: Request processed in 342us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526570.141616:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:3.0:1788526570.141843:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868896640 00000100:00100000:3.0:1788526570.141850:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868896640 00000100:00100000:3.0:1788526570.141898:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1788526570.141919:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868896640:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1788526570.152223:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896896:12345-192.168.204.59@tcp:400: Request processed in 10718us (11001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526570.152223:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868896768:12345-192.168.204.59@tcp:400: Request processed in 10911us (11084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.152243:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:2.0:1788526570.152503:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526570.152512:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526570.152516:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526570.156006:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868896640:12345-192.168.204.59@tcp:400: Request processed in 14080us (14827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526570.156070:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526570.156095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00010000:00010000:2.0:1788526570.707773:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526570.964802:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881506432:0@lo:400: 00000100:00100000:1.0:1788526570.964926:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526570.965221:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881506048:0@lo:400: 00000100:00100000:2.0:1788526570.965267:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526570.965298:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881506560:0@lo:400: 00000100:00100000:2.0:1788526570.965325:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526570.965376:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506048 00000100:00100000:2.0:1788526570.965408:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506048 00000100:00100000:2.0:1788526570.965471:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788526570.965483:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3281:x1875405881506048:12345-0@lo:400: 00000100:00100000:2.0:1788526570.965545:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:3281:x1875405881506048:12345-0@lo:400: Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.965553:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788526570.965627:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881506048:0@lo:400: 00000100:00100000:2.0:1788526570.965678:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506432 00000100:00100000:2.0:1788526570.965682:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506432 00000100:00100000:2.0:1788526570.965727:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526570.965734:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881506432:12345-0@lo:400: 00000100:00100000:2.0:1788526570.965770:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881506432:12345-0@lo:400: Request processed in 36us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.965797:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526570.965820:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881506304:0@lo:400: 00000100:00100000:2.0:1788526570.965974:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526570.965999:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788526570.966085:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881506176:0@lo:400: 00000100:00100000:2.0:1788526570.966113:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526570.966134:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881506688:0@lo:400: 00000100:00100000:2.0:1788526570.966160:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788526570.966188:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788526570.966202:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506688 00000100:00100000:2.0:1788526570.966206:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506688 00000100:00100000:2.0:1788526570.966242:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788526570.966248:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881506688:12345-0@lo:400: 00000100:00100000:2.0:1788526570.966287:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881506688:12345-0@lo:400: Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.966294:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788526570.966313:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506560 00000100:00100000:2.0:1788526570.966317:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506560 00000100:00100000:2.0:1788526570.966345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506304 00000100:00100000:2.0:1788526570.966349:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506304 00000100:00100000:2.0:1788526570.966365:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506176 00000100:00100000:2.0:1788526570.966368:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506176 00000100:00100000:2.0:1788526570.966382:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526570.966418:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881506560:12345-0@lo:400: 00000100:00100000:2.0:1788526570.966460:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881506560:12345-0@lo:400: Request processed in 45us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.966467:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526570.966491:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788526570.966498:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881506304:12345-0@lo:400: 00000100:00100000:2.0:1788526570.966529:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881506304:12345-0@lo:400: Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.966535:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788526570.966547:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788526570.966553:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881506176:12345-0@lo:400: 00000100:00100000:2.0:1788526570.966579:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881506176:12345-0@lo:400: Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526570.966584:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788526570.966735:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220700 x1875405881506432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526570.966751:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881506432:0@lo:400: 00000100:00100000:3.0:1788526570.967171:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526570.967190:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881506816:0@lo:13: 00000100:00100000:3.0:1788526570.967252:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526570.967308:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506816 00000100:00100000:3.0:1788526570.967315:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506816 00000100:00100000:3.0:1788526570.967356:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788526570.967364:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881506816:12345-0@lo:13: 00002000:00000024:3.0:1788526570.967451:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526570.967496:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881506816:12345-0@lo:13: Request processed in 133us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526570.967503:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788526570.967544:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249742300 x1875405881506816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526570.967562:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881506816:0@lo:13: 00000100:00100000:1.0:1788526570.979056:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881506176:0@lo:400: 00010000:00080000:1.0:1788526570.979091:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220380 x1875405881506688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526570.979105:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881506688:0@lo:400: 00000100:00100000:1.0:1788526570.979120:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881506304:0@lo:400: 00000100:00100000:1.0:1788526570.979208:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881506560:0@lo:400: 00000100:00080000:2.0:1788526570.985173:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526570.985191:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788526571.477569:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788526571.477582:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c274ba0000 from 39 10000000:01000000:2.0:1788526571.477591:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788526571.477670:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.477685:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.477699:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526571.477735:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881506944:0@lo:101: 00000100:00100000:2.0:1788526571.477855:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.477955:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c281e97000 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.478835:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881506944 00000100:00100000:0.0:1788526571.478852:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881506944 00000100:00100000:0.0:1788526571.478950:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788526571.478962:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+12:5820:x1875405881506944:12345-0@lo:101: 00010000:00010000:0.0:1788526571.478981:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526571.479123:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c28216c000/0x367645d450b3a1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a1dd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.479163:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c28216c000/0x367645d450b3a1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a1dd expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.479177:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c28216c000/0x367645d450b3a1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a1dd expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.479189:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216c000, rc 0) 00000100:00100000:0.0:1788526571.479280:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881506944:12345-0@lo:101: Request processed in 321us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.479307:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788526571.479627:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881506944:0@lo:101: 00010000:00010000:3.0:1788526571.479651:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.479662:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526571.480767:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788526571.495524:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526571.496539:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788526571.496627:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:3.0:1788526571.496661:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:3.0:1788526571.496717:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:3.0:1788526571.496761:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:3.0:1788526571.502726:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:3.0:1788526571.503020:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:3.0:1788526571.503100:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:3.0:1788526571.503166:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:3.0:1788526571.503205:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:3.0:1788526571.503239:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:3.0:1788526571.503307:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:3.0:1788526571.503349:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:3.0:1788526571.503444:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:3.0:1788526571.509425:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:3.0:1788526571.509490:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:3.0:1788526571.509523:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:3.0:1788526571.509568:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:3.0:1788526571.509600:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:3.0:1788526571.509632:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:3.0:1788526571.509675:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:3.0:1788526571.509710:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:3.0:1788526571.509739:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:3.0:1788526571.510697:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:3.0:1788526571.510749:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 128 off12440 00000040:00080000:3.0:1788526571.510800:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12664 00000040:00080000:3.0:1788526571.510926:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12888 00000040:00080000:3.0:1788526571.510965:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off12968 00000040:00080000:3.0:1788526571.511185:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13192 00000040:00080000:3.0:1788526571.511246:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13416 00000040:00080000:3.0:1788526571.511282:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13504 00000040:00080000:3.0:1788526571.511318:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13632 00000040:00080000:3.0:1788526571.511350:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13776 00000040:00080000:3.0:1788526571.511659:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13904 00000040:00080000:3.0:1788526571.511705:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14128 00000040:00080000:3.0:1788526571.512166:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14352 00000040:00080000:3.0:1788526571.512210:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14432 00000040:00080000:3.0:1788526571.512326:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14656 00000040:00080000:3.0:1788526571.512334:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788526571.512526:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507072:0@lo:501: 00000100:00100000:3.0:1788526571.512623:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.512683:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c272281f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.514318:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507072 00000100:00100000:0.0:1788526571.514339:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507072 00000100:00100000:0.0:1788526571.514503:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788526571.514519:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507072:12345-0@lo:501: 00000100:00100000:0.0:1788526571.515300:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507072:12345-0@lo:501: Request processed in 781us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.515312:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788526571.517922:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507072:0@lo:501: 00000100:00100000:3.0:1788526571.518035:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507200:0@lo:503: 00000100:00100000:3.0:1788526571.518152:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.518207:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c272281f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.518362:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507200 00000100:00100000:2.0:1788526571.518372:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507200 00000100:00100000:2.0:1788526571.518485:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788526571.518497:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507200:12345-0@lo:503: 00000100:00100000:2.0:1788526571.518783:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507200:12345-0@lo:503: Request processed in 287us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.518793:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788526571.519255:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507200:0@lo:503: 00000040:00080000:2.0:1788526571.522719:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526571.522911:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507328:0@lo:502: 00000100:00100000:2.0:1788526571.523089:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.523174:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24bfca540 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.523559:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507328 00000100:00100000:0.0:1788526571.523570:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507328 00000100:00100000:0.0:1788526571.523640:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788526571.523651:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507328:12345-0@lo:502: 00000100:00100000:0.0:1788526571.524072:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507328:12345-0@lo:502: Request processed in 422us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.524082:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788526571.524467:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507328:0@lo:502: 00000040:00080000:3.0:1788526571.525052:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788526571.525127:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:3.0:1788526571.525164:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:3.0:1788526571.525215:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:3.0:1788526571.525252:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:3.0:1788526571.525300:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:3.0:1788526571.525336:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:3.0:1788526571.525370:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:3.0:1788526571.525457:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:3.0:1788526571.525495:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:3.0:1788526571.525529:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:3.0:1788526571.525598:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:3.0:1788526571.525640:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:3.0:1788526571.525674:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:3.0:1788526571.525724:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:3.0:1788526571.525760:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:3.0:1788526571.529420:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:3.0:1788526571.529563:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:3.0:1788526571.529606:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:3.0:1788526571.529644:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:3.0:1788526571.529699:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:3.0:1788526571.529738:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:3.0:1788526571.529772:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:3.0:1788526571.530977:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:2.0:1788526571.532829:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 128 off12440 00000040:00080000:2.0:1788526571.532899:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12664 00000040:00080000:2.0:1788526571.533007:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12888 00000040:00080000:2.0:1788526571.533048:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off12968 00000040:00080000:2.0:1788526571.533084:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13192 00000040:00080000:2.0:1788526571.533135:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13416 00000040:00080000:2.0:1788526571.533175:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13504 00000040:00080000:2.0:1788526571.533212:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13632 00000040:00080000:2.0:1788526571.533251:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13776 00000040:00080000:2.0:1788526571.533303:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13904 00000040:00080000:2.0:1788526571.533339:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14128 00000040:00080000:2.0:1788526571.533450:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14352 00000040:00080000:2.0:1788526571.533491:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14432 00000040:00080000:2.0:1788526571.533523:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14656 00000040:00080000:2.0:1788526571.533573:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14880 00000040:00080000:2.0:1788526571.533612:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 120 off15000 00000100:00100000:2.0:1788526571.533685:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507456:0@lo:502: 00000100:00100000:2.0:1788526571.533816:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.533867:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.534093:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507456 00000100:00100000:0.0:1788526571.534105:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507456 00000100:00100000:0.0:1788526571.534182:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788526571.534194:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507456:12345-0@lo:502: 00000100:00100000:0.0:1788526571.534547:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507456:12345-0@lo:502: Request processed in 353us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.534558:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788526571.536090:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507456:0@lo:502: 00000040:00080000:3.0:1788526571.536293:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 224 off15224 00000040:00080000:3.0:1788526571.536329:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:1.0:1788526571.542822:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000020:01000000:3.0:1788526571.543339:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788526571.543366:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788526571.543382:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.543426:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526571.543444:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788526571.543447:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788526571.543451:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788526571.543508:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.543518:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.543533:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526571.543565:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507584:0@lo:101: 00000100:00100000:3.0:1788526571.543673:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.543731:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c272281d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.543814:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507584 00000100:00100000:2.0:1788526571.543838:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507584 00000100:00100000:2.0:1788526571.543941:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788526571.543953:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+13:5820:x1875405881507584:12345-0@lo:101: 00010000:00010000:2.0:1788526571.543973:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.543991:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240031600/0x367645d450b3a1f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a1eb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.544044:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240031600/0x367645d450b3a1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a1eb expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.544059:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240031600/0x367645d450b3a1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a1eb expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.544070:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031600, rc 0) 00000100:00100000:2.0:1788526571.544123:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507584:12345-0@lo:101: Request processed in 172us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.544131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788526571.544312:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507584:0@lo:101: 00010000:00010000:3.0:1788526571.544330:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.544340:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.545010:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526571.545200:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897024 00000100:00100000:2.0:1788526571.545207:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897024 00000100:00100000:2.0:1788526571.545255:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:2.0:1788526571.545265:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+8:5591:x1875405868897024:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1788526571.545279:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.545297:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030000/0x367645d450b3a1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59303 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.545320:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030000/0x367645d450b3a1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59303 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.545331:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030000/0x367645d450b3a1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59303 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.545355:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030000, rc 0) 00000100:00100000:2.0:1788526571.545451:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897024:12345-192.168.204.59@tcp:101: Request processed in 187us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.545459:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 147 00000040:00080000:1.0:1788526571.548073:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788526571.548653:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526571.550062:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526571.550237:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897152 00000100:00100000:3.0:1788526571.550252:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897152 00000100:00100000:3.0:1788526571.550329:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:3.0:1788526571.550342:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897152:12345-192.168.204.59@tcp:501: 00000040:00080000:1.0:1788526571.552418:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788526571.552570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:1.0:1788526571.552609:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:1.0:1788526571.552661:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:1.0:1788526571.552699:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:1.0:1788526571.552731:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000100:00100000:3.0:1788526571.554222:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897152:12345-192.168.204.59@tcp:501: Request processed in 478us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.554254:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00000040:00080000:1.0:1788526571.555294:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:1.0:1788526571.555321:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788526571.555515:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507712:0@lo:501: 00000100:00100000:1.0:1788526571.555633:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.555707:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.556837:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507712 00000100:00100000:2.0:1788526571.556854:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507712 00000100:00100000:2.0:1788526571.556940:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788526571.556951:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507712:12345-0@lo:501: 00000100:00100000:2.0:1788526571.557381:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507712:12345-0@lo:501: Request processed in 429us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.557425:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788526571.559074:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526571.559268:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897280 00000100:00100000:3.0:1788526571.559281:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897280 00000100:00100000:3.0:1788526571.559350:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:3.0:1788526571.559362:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897280:12345-192.168.204.59@tcp:503: 00000100:00100000:1.0:1788526571.560354:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507712:0@lo:501: 00000100:00100000:1.0:1788526571.560459:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507840:0@lo:503: 00000100:00100000:3.0:1788526571.560694:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897280:12345-192.168.204.59@tcp:503: Request processed in 1330us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.560706:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:1.0:1788526571.562275:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.562335:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.562428:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507840 00000100:00100000:0.0:1788526571.562439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507840 00000100:00100000:0.0:1788526571.562516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788526571.562556:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507840:12345-0@lo:503: 00000100:00100000:1.0:1788526571.564620:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507840:12345-0@lo:503: Request processed in 2053us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.564641:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788526571.565008:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507840:0@lo:503: 00000040:00080000:3.0:1788526571.565833:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526571.565968:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507968:0@lo:502: 00000100:00100000:3.0:1788526571.566062:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.566120:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c272281f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.566452:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526571.566655:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881507968 00000100:00100000:1.0:1788526571.566665:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881507968 00000100:00100000:1.0:1788526571.566725:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897408 00000100:00100000:1.0:1788526571.566729:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897408 00000100:00100000:1.0:1788526571.566746:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788526571.566756:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507968:12345-0@lo:502: 00000100:00100000:2.0:1788526571.566931:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:2.0:1788526571.566943:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:6065:x1875405868897408:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1788526571.567238:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:6065:x1875405868897408:12345-192.168.204.59@tcp:502: Request processed in 297us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.567247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:1.0:1788526571.567512:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881507968:12345-0@lo:502: Request processed in 757us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.567530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788526571.569938:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881507968:0@lo:502: 00000040:00080000:2.0:1788526571.570365:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788526571.570478:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:2.0:1788526571.570521:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788526571.570570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788526571.570610:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788526571.570645:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788526571.570728:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:2.0:1788526571.570769:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788526571.570834:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:2.0:1788526571.570909:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508096:0@lo:502: 00000100:00100000:2.0:1788526571.571009:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.571064:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.571966:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508096 00000100:00100000:1.0:1788526571.571981:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508096 00000100:00100000:1.0:1788526571.572053:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788526571.572065:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881508096:12345-0@lo:502: 00000100:00100000:1.0:1788526571.572423:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881508096:12345-0@lo:502: Request processed in 359us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.572433:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788526571.573182:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508096:0@lo:502: 00000040:00080000:2.0:1788526571.573359:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:2.0:1788526571.573382:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788526571.575327:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526571.575345:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526571.575347:0:8452:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788526571.575353:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788526571.575373:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526571.575376:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526571.575377:0:8452:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788526571.575381:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000100:00100000:1.0:1788526571.576024:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526571.576116:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897536 00000100:00100000:2.0:1788526571.576130:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897536 00000100:00100000:2.0:1788526571.576200:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:2.0:1788526571.576213:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:6065:x1875405868897536:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788526571.576601:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:6065:x1875405868897536:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 389us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.576611:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00000020:01000000:3.0:1788526571.577305:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788526571.577330:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788526571.577345:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.577360:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526571.577702:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788526571.577707:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c274ba0000 from 1 10000000:01000000:1.0:1788526571.577711:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788526571.577767:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.577777:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.577791:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.578124:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.578221:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.578333:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.578599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508224 00000100:00100000:3.0:1788526571.578612:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508224 00000100:00100000:3.0:1788526571.578680:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788526571.578692:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+14:5820:x1875405881508224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526571.578709:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526571.578729:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55000/0x367645d450b3a207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a200 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.578763:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55000/0x367645d450b3a207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a200 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.578776:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55000/0x367645d450b3a207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a200 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.578787:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55000, rc 0) 00000100:00100000:3.0:1788526571.579019:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.579027:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788526571.579125:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526571.579145:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.579174:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.579304:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.579341:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.579488:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.579676:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508352 00000100:00100000:0.0:1788526571.579684:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508352 00000100:00100000:0.0:1788526571.579758:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788526571.579770:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.580202:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (859us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526571.580212:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788526571.580288:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788526571.580310:0:5820:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788526571.580367:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.580433:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.580774:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.580818:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508480 00000100:00100000:2.0:1788526571.580826:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508480 00000100:00100000:2.0:1788526571.580871:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788526571.580892:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.581111:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (676us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526571.581131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788526571.581279:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508480:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788526571.581322:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788526571.581334:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.581344:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526571.581357:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788526571.581360:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c27453b800 from 39 10000000:01000000:1.0:1788526571.581364:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526571.581471:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.581480:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.581499:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.581517:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.581569:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.581597:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.581759:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508608 00000100:00100000:2.0:1788526571.581767:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508608 00000100:00100000:2.0:1788526571.581792:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788526571.581801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:5820:x1875405881508608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526571.581812:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.581839:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240031400/0x367645d450b3a215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a20e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.581866:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240031400/0x367645d450b3a215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a20e expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.581899:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240031400/0x367645d450b3a215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a20e expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.581909:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240031400, rc 0) 00000100:00100000:2.0:1788526571.581952:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.581959:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788526571.582086:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526571.582102:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.582111:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526571.583005:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 39 count 39 00000040:00080000:1.0:1788526571.584164:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788526571.584554:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788526571.584606:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788526571.584642:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788526571.584692:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788526571.584733:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788526571.584788:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788526571.584826:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788526571.584862:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000100:00100000:0.0:1788526571.586126:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526571.586378:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897664 00000100:00100000:3.0:1788526571.586417:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897664 00000100:00100000:3.0:1788526571.586490:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:3.0:1788526571.586504:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868897664:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526571.586636:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526571.586663:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55400/0x367645d450b3a21c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5930a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.586705:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55400/0x367645d450b3a21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5930a expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.586737:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55400/0x367645d450b3a21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5930a expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.586750:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55400, rc 0) 00000100:00100000:3.0:1788526571.586922:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868897664:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 421us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.586930:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 160 00000040:00080000:1.0:1788526571.587782:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788526571.587944:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788526571.587987:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788526571.588050:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788526571.588089:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788526571.588123:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788526571.588194:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788526571.588231:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788526571.588266:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788526571.588318:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788526571.588356:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000100:00100000:3.0:1788526571.588757:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526571.589237:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897792 00000100:00100000:0.0:1788526571.589251:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897792 00000100:00100000:0.0:1788526571.589322:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:0.0:1788526571.589333:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868897792:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.589741:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868897792:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 407us (986us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526571.589750:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 161 00000040:00080000:1.0:1788526571.590106:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788526571.590246:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788526571.590285:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788526571.590318:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788526571.590368:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788526571.590458:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788526571.590494:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788526571.591325:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788526571.591381:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788526571.591619:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788526571.591675:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788526571.591713:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788526571.591748:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788526571.591781:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788526571.591920:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788526571.591962:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788526571.592015:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788526571.592054:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788526571.592183:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788526571.592192:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 38 count 39 00000100:00100000:1.0:1788526571.592338:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.592694:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.592828:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.592955:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508736 00000100:00100000:0.0:1788526571.592967:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508736 00000100:00100000:0.0:1788526571.593070:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788526571.593083:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.593506:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.593516:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788526571.593630:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.593684:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.593747:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.594120:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.594202:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508864 00000100:00100000:3.0:1788526571.594210:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508864 00000100:00100000:3.0:1788526571.594244:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788526571.594252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.594490:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.594499:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788526571.594665:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788526571.595444:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526571.595586:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508992:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.595656:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.595701:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.596006:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881508992 00000100:00100000:3.0:1788526571.596015:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881508992 00000100:00100000:3.0:1788526571.596058:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788526571.596067:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508992:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.596340:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881508992:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 274us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.596350:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788526571.596582:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881508992:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788526571.596972:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788526571.597042:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788526571.597081:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788526571.597137:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788526571.597177:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788526571.597235:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788526571.597274:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788526571.597313:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788526571.597439:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788526571.597485:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788526571.597523:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788526571.597594:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788526571.597632:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788526571.597668:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788526571.597719:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788526571.597768:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788526571.597795:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788526571.597841:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788526571.597895:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788526571.597935:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788526571.597985:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788526571.598036:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788526571.598068:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788526571.598123:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788526571.598158:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788526571.598192:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788526571.598235:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788526571.598270:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788526571.598299:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788526571.598349:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788526571.598423:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788526571.598479:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788526571.598516:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788526571.598570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788526571.598610:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788526571.598657:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788526571.598691:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788526571.598723:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788526571.598774:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788526571.598811:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788526571.598900:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509120:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.599010:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.599079:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.599435:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509120 00000100:00100000:3.0:1788526571.599449:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509120 00000100:00100000:3.0:1788526571.599511:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788526571.599538:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881509120:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.599901:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881509120:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 366us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.599910:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788526571.600351:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509120:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788526571.600785:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788526571.600805:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000040:00080000:1.0:1788526571.608754:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788526571.609116:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788526571.609137:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788526571.609152:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.609166:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526571.609184:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788526571.609208:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788526571.609212:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788526571.609269:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.609278:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.609294:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526571.609331:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.610184:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.610323:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.610381:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509248 00000100:00100000:3.0:1788526571.610510:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509248 00000100:00100000:3.0:1788526571.610796:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788526571.610810:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:5820:x1875405881509248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526571.610981:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526571.611007:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54c00/0x367645d450b3a22a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a223 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.611044:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54c00/0x367645d450b3a22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a223 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.611059:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54c00/0x367645d450b3a22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a223 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.611071:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54c00, rc 0) 00000100:00100000:3.0:1788526571.611155:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 348us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.611163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788526571.611274:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526571.611300:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.611313:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526571.612087:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788526571.612675:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526571.613020:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788526571.613090:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788526571.613125:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788526571.613176:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788526571.613213:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788526571.613246:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788526571.613296:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788526571.613336:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788526571.613442:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788526571.613533:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788526571.613542:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:2.0:1788526571.613680:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.613800:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.614865:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.615124:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509376 00000100:00100000:0.0:1788526571.615139:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509376 00000100:00100000:1.0:1788526571.615373:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788526571.615419:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.616049:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 661us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.616066:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788526571.616204:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.616281:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.616345:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.616692:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27bbc1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.616898:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509504 00000100:00100000:3.0:1788526571.616908:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509504 00000100:00100000:3.0:1788526571.616952:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788526571.616962:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.617244:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 283us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.617262:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788526571.617498:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526571.618961:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526571.619108:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509632:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.619228:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526571.619342:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b89e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.619756:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509632 00000100:00100000:3.0:1788526571.619767:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509632 00000100:00100000:2.0:1788526571.620015:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788526571.620028:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509632:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.620353:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509632:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 326us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.620362:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788526571.620498:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509632:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526571.620869:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788526571.620945:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788526571.620981:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788526571.621032:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788526571.621094:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788526571.621131:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788526571.621178:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788526571.621211:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788526571.621245:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788526571.621295:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788526571.621332:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788526571.621382:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788526571.621477:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509760:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.621550:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.622127:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.622234:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509760 00000100:00100000:1.0:1788526571.622243:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509760 00000100:00100000:1.0:1788526571.622298:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788526571.622309:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509760:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.623052:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509760:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 741us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.623063:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788526571.623196:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509760:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526571.623338:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788526571.623357:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788526571.625947:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526571.625966:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526571.625969:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788526571.625976:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788526571.626001:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526571.626005:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526571.626031:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788526571.626035:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788526571.626284:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788526571.626305:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788526571.626322:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.626337:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526571.626352:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788526571.626356:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c27453b800 from 1 10000000:01000000:1.0:1788526571.626361:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788526571.626460:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.626471:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.626485:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.626529:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.626642:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.626704:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.626966:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881509888 00000100:00100000:2.0:1788526571.626976:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881509888 00000100:00100000:2.0:1788526571.627036:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788526571.627048:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:5820:x1875405881509888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526571.627066:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.627085:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030e00/0x367645d450b3a238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a231 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.627117:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030e00/0x367645d450b3a238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a231 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.627130:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030e00/0x367645d450b3a238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a231 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.627141:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030e00, rc 0) 00000100:00100000:2.0:1788526571.627200:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881509888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.627208:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788526571.627446:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881509888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526571.627467:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.627477:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.627799:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.627931:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.627970:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.628044:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510016 00000100:00100000:2.0:1788526571.628051:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510016 00000100:00100000:2.0:1788526571.628088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788526571.628097:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881510016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.628453:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881510016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (520us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526571.628462:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788526571.628754:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510016:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788526571.628774:0:5820:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788526571.628959:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.629005:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.629045:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.629097:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510144 00000100:00100000:2.0:1788526571.629105:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510144 00000100:00100000:2.0:1788526571.629211:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788526571.629222:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881510144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.629475:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881510144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (468us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526571.629484:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788526571.630061:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788526571.630120:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788526571.630134:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.630148:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526571.630163:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788526571.630181:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c248515800 from 39 10000000:01000000:1.0:1788526571.630185:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526571.630234:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.630244:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.630255:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.630275:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.630330:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.630459:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526571.630762:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510272 00000100:00100000:3.0:1788526571.630770:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510272 00000100:00100000:2.0:1788526571.630990:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788526571.631002:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881510272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526571.631019:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.631038:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c240030400/0x367645d450b3a246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a23f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.631071:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c240030400/0x367645d450b3a246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a23f expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.631083:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c240030400/0x367645d450b3a246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a23f expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.631094:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c240030400, rc 0) 00000100:00100000:2.0:1788526571.631154:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.631161:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788526571.631239:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526571.631256:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.631281:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526571.631333:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.631366:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.631798:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.631930:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510400 00000100:00100000:1.0:1788526571.631937:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510400 00000100:00100000:1.0:1788526571.631996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788526571.632004:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.632420:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.632429:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788526571.632539:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.632743:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.633057:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.633099:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.633188:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510528 00000100:00100000:2.0:1788526571.633195:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510528 00000100:00100000:2.0:1788526571.633233:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788526571.633241:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.633474:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.633492:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788526571.633816:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.634301:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8455:1875405881510656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526571.634363:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.634430:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.635013:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510656 00000100:00100000:2.0:1788526571.635023:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510656 00000100:00100000:2.0:1788526571.635118:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788526571.635130:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:8455:x1875405881510656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526571.635489:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:8455:x1875405881510656:12345-0@lo:502:llog_process_th.0 Request processed in 362us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.635498:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788526571.635913:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8455:1875405881510656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526571.635997:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8455:1875405881510784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526571.636050:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.636336:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.641984:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510784 00000100:00100000:1.0:1788526571.642013:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510784 00000100:00100000:1.0:1788526571.642133:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788526571.642148:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:8455:x1875405881510784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788526571.642655:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:8455:x1875405881510784:12345-0@lo:502:llog_process_th.0 Request processed in 509us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.642664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788526571.643600:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8455:1875405881510784:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788526571.643674:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788526571.644268:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788526571.644285:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788526571.644301:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.644315:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526571.644328:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788526571.644331:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788526571.644335:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788526571.644422:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.644433:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.644446:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.644480:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.644656:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.644712:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.644792:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881510912 00000100:00100000:2.0:1788526571.644801:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881510912 00000100:00100000:2.0:1788526571.645085:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788526571.645098:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881510912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526571.645117:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526571.645139:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282045800/0x367645d450b3a254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a24d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.645175:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282045800/0x367645d450b3a254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a24d expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.645189:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282045800/0x367645d450b3a254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a24d expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.645200:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045800, rc 0) 00000100:00100000:2.0:1788526571.645263:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881510912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.645270:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788526571.645449:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881510912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526571.645473:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.645483:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526571.645674:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.645711:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.645742:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526571.646731:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511040 00000100:00100000:2.0:1788526571.646763:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511040 00000100:00100000:2.0:1788526571.646915:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788526571.646927:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881511040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526571.647355:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881511040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526571.647366:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788526571.648727:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.648923:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.649036:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.649273:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.652641:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511168 00000100:00100000:0.0:1788526571.652666:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511168 00000100:00100000:0.0:1788526571.652804:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788526571.653237:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881511168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.653664:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881511168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 846us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.653675:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788526571.653868:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526571.655679:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8456:1875405881511296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788526571.655810:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526571.656059:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.656139:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511296 00000100:00100000:0.0:1788526571.656147:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511296 00000100:00100000:0.0:1788526571.656206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788526571.656217:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:8456:x1875405881511296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788526571.656615:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:8456:x1875405881511296:12345-0@lo:502:llog_process_th.0 Request processed in 397us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526571.656624:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788526571.656921:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8456:1875405881511296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526571.656964:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526571.656976:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526571.656978:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788526571.656986:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788526571.657020:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8456:1875405881511424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526571.657069:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.657093:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.657294:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511424 00000100:00100000:1.0:1788526571.657302:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511424 00000100:00100000:1.0:1788526571.657331:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788526571.657339:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:8456:x1875405881511424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788526571.657596:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:8456:x1875405881511424:12345-0@lo:502:llog_process_th.0 Request processed in 256us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.657605:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788526571.658286:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8456:1875405881511424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526571.658332:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526571.658340:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526571.658343:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788526571.658348:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788526571.659045:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788526571.659061:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788526571.659077:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.659091:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526571.659105:0:5820:0:(mgc_request.c:714:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788526571.659108:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c248515800 from 1 10000000:01000000:0.0:1788526571.659112:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788526571.659158:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.659168:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526571.659192:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526571.659219:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.659294:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526571.659437:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2743f4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526571.659661:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511552 00000100:00100000:1.0:1788526571.659670:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511552 00000100:00100000:1.0:1788526571.659767:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788526571.661966:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881511552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526571.662000:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526571.662039:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241662a00/0x367645d450b3a262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a25b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.662085:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241662a00/0x367645d450b3a262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a25b expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.662099:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241662a00/0x367645d450b3a262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a25b expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526571.662134:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241662a00, rc 0) 00000100:00100000:1.0:1788526571.662264:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881511552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2487us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526571.662272:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788526571.662650:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526571.662677:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.662689:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526571.662763:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526571.662820:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.665253:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24515f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526571.665661:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511680 00000100:00100000:0.0:1788526571.665678:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511680 00000100:00100000:0.0:1788526571.665745:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788526571.665757:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881511680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526571.666192:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881511680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (3370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526571.666202:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788526571.666500:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881511680:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788526571.666542:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788526571.666556:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526571.666570:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526571.733791:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526571.990120:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881511808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526571.990253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526571.991560:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881511808 00000100:00100000:3.0:1788526571.991591:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881511808 00000100:00100000:3.0:1788526571.991689:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526571.991702:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881511808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526571.991769:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526571.991922:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881511808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526571.991931:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788526571.992739:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220700 x1875405881511808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526571.992771:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881511808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788526572.755920:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788526573.033923:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebc393300 20000000:00000080:1.0:1788526573.033943:0:8494:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c274a8d000 uarg=0000000000000000 20000000:01000000:1.0:1788526573.033978:0:8494:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788526573.033984:0:8494:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788526573.033990:0:8494:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788526573.040748:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788526573.040939:0:8494:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788526573.046651:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788526573.046739:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788526573.046810:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788526573.046831:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788526573.046864:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046903:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a001 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046911:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a07f expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046918:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a0da expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046929:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046937:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046981:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.046998:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 9 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526573.047013:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881511936:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526573.048804:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.048827:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 20 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526573.048842:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512064:0@lo:104: 00000100:00100000:0.0:1788526573.048934:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526573.048978:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.048987:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 20 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526573.048995:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512192:0@lo:104: 00000100:00100000:0.0:1788526573.049017:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526573.049063:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512064 00000100:00100000:0.0:1788526573.049071:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512064 00000100:00100000:0.0:1788526573.049115:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512192 00000100:00100000:0.0:1788526573.049118:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512192 00000100:00100000:0.0:1788526573.049132:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788526573.049141:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:8494:x1875405881512064:12345-0@lo:104: 00010000:00010000:0.0:1788526573.049156:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.049205:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788526573.049211:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:8494:x1875405881512064:12345-0@lo:104: Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526573.049218:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788526573.049234:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788526573.049240:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8494:x1875405881512192:12345-0@lo:104: 00010000:00010000:0.0:1788526573.049249:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.049277:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788526573.049282:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8494:x1875405881512192:12345-0@lo:104: Request processed in 42us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526573.049294:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788526573.049329:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.049338:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 20 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526573.049347:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512320:0@lo:104: 00000100:00100000:0.0:1788526573.049370:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526573.049410:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512320 00000100:00100000:0.0:1788526573.049415:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512320 00000100:00100000:0.0:1788526573.049432:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526573.049439:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8494:x1875405881512320:12345-0@lo:104: 00010000:00010000:0.0:1788526573.049447:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.049477:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788526573.049482:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:8494:x1875405881512320:12345-0@lo:104: Request processed in 45us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526573.049488:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526573.049507:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27477fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526573.049529:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512064:0@lo:104: 00000100:00100000:0.0:1788526573.049537:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512192:0@lo:104: 00000100:00100000:0.0:1788526573.049544:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881512320:0@lo:104: 00010000:00010000:2.0:1788526573.049631:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788526573.049639:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049647:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526573.049653:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049662:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526573.049670:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526573.049676:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788526573.049715:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049722:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526573.049743:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049750:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282044800/0x367645d450b3a0da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a0e1 expref: -99 pid: 7611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049770:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526573.049773:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049778:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663000 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526573.049781:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049788:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526573.049794:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526573.049798:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788526573.049811:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049817:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526573.049836:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049842:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663000/0x367645d450b3a07f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a086 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049863:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526573.049866:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049882:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044000 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526573.049885:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049891:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526573.049897:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526573.049901:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788526573.049914:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049919:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526573.049925:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049931:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a001 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a008 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.049943:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526573.049945:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526573.049946:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526573.049954:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526573.049959:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526573.049969:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881512448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526573.050001:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526573.050037:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881512576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526573.050065:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526573.050083:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526573.050088:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881512704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526573.050105:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526573.050132:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512448 00000100:00100000:2.0:1788526573.050143:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512448 00010000:00010000:2.0:1788526573.050167:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 21 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526573.050181:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512576 00000100:00100000:2.0:1788526573.050184:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512576 00010000:00010000:2.0:1788526573.050195:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 22 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526573.050205:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512704 00000100:00100000:2.0:1788526573.050207:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512704 00010000:00010000:2.0:1788526573.050217:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 23 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526573.050228:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788526573.050233:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+23:3281:x1875405881512448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526573.050244:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526573.050249:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 23 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050258:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 23 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050273:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55200/0x367645d450b3a0e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a0da expref: 23 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050296:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526573.050326:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+22:3281:x1875405881512448:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526573.050333:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788526573.050348:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526573.050354:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881512576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526573.050361:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526573.050366:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 21 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050374:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 21 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050410:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241663e00/0x367645d450b3a086 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a07f expref: 21 pid: 5817 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050420:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526573.050446:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3278:x1875405881512576:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526573.050453:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526573.050465:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526573.050471:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3278:x1875405881512704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526573.050478:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526573.050482:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 19 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050490:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 19 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050507:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045a00/0x367645d450b3a008 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a001 expref: 19 pid: 5815 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526573.050515:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526573.050536:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3278:x1875405881512704:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526573.050542:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526573.050571:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881512448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526573.050596:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881512704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526573.050603:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881512576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788526573.061731:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526573.064763:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875405881511936:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526573.064809:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526573.066190:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868897920 00000100:00100000:2.0:1788526573.066203:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868897920 00010000:00010000:3.0:1788526573.066334:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526573.066380:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1788526573.066424:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868897920:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526573.066439:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526573.066445:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066456:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066508:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241662200/0x367645d450b3a1ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592d2 expref: 10 pid: 5817 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066525:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066534:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066552:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066559:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066566:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066573:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066580:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526573.066585:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066594:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066603:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.066623:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526573.066683:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+9:2348:x1875405868897920:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 260us (4967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526573.066691:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00010000:00010000:0.0:1788526573.067801:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.067834:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526573.067842:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c28216c200/0x367645d450b3a269 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526573.780107:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526574.299482:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526574.299614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898048 00000100:00100000:2.0:1788526574.299625:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898048 00000100:00100000:2.0:1788526574.299686:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:2.0:1788526574.299696:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+9:5591:x1875405868898048:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526574.299713:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526574.299734:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59311 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.299764:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.299775:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.299803:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044000, rc 0) 00000100:00100000:2.0:1788526574.299869:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868898048:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 175us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.299876:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:3.0:1788526574.307705:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526574.307786:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898176 00000100:00100000:2.0:1788526574.307797:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898176 00000100:00100000:2.0:1788526574.307864:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:2.0:1788526574.307874:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868898176:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.308212:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868898176:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 338us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.308222:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:2.0:1788526574.317509:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526574.317740:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898304 00000100:00100000:1.0:1788526574.317752:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898304 00000100:00100000:1.0:1788526574.317858:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:1.0:1788526574.317870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868898304:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526574.318118:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:5591:x1875405868898304:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 249us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526574.318126:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:1.0:1788526574.325701:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526574.325963:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898432 00000100:00100000:0.0:1788526574.325973:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898432 00000100:00100000:0.0:1788526574.326028:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:0.0:1788526574.326039:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:6123:x1875405868898432:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526574.326309:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:6123:x1875405868898432:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 270us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526574.326318:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:0.0:1788526574.344445:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526574.344562:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898560 00000100:00100000:2.0:1788526574.344576:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898560 00000100:00100000:2.0:1788526574.344645:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:2.0:1788526574.344657:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:6123:x1875405868898560:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788526574.344994:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:6123:x1875405868898560:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 338us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.345003:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 190 10000000:01000000:0.0:1788526574.675463:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788526574.675472:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c274ba0000 from 4 10000000:01000000:0.0:1788526574.675479:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788526574.675531:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.675546:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.675560:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526574.675601:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881512832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.675704:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.675773:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27477f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.676066:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512832 00000100:00100000:2.0:1788526574.676076:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512832 00000100:00100000:2.0:1788526574.676131:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788526574.676142:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881512832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526574.676158:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526574.677108:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a277 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.677243:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a277 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.677262:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a277 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.677273:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044600, rc 0) 00000100:00100000:2.0:1788526574.677357:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881512832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1215us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.677366:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788526574.677492:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881512832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526574.677510:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.677522:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526574.678744:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788526574.680342:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526574.682099:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788526574.682159:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:0.0:1788526574.682725:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:0.0:1788526574.682734:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788526574.682862:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881512960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.684205:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.684267:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27477f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526574.684285:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881512960 00000100:00100000:1.0:1788526574.684294:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881512960 00000100:00100000:1.0:1788526574.684356:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788526574.684374:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881512960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526574.684713:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881512960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526574.684721:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788526574.684796:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881512960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.684861:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.684911:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526574.684944:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2623cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526574.685840:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513088 00000100:00100000:1.0:1788526574.685849:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513088 00000100:00100000:1.0:1788526574.685917:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788526574.685926:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526574.686105:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526574.686113:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788526574.687030:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788526574.689833:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526574.689939:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513216:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.690024:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526574.690068:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c243c45600 going to sleep for 11 seconds 00000100:00100000:0.0:1788526574.690164:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513216 00000100:00100000:0.0:1788526574.690173:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513216 00000100:00100000:0.0:1788526574.690225:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788526574.690234:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513216:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.690458:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513216:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 224us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526574.690466:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788526574.690523:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513216:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788526574.690808:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788526574.690875:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788526574.690926:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788526574.690964:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788526574.690999:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:0.0:1788526574.691023:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513344:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.691060:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.691085:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513344 00000100:00100000:0.0:1788526574.691090:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513344 00000100:00100000:0.0:1788526574.691111:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788526574.691119:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513344:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.691251:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513344:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526574.691259:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788526574.691289:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27477fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526574.691303:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513344:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788526574.691422:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788526574.691433:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788526574.692081:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526574.692091:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526574.692094:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788526574.692100:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c274ba0000 00000020:00000080:0.0:1788526574.692103:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526574.694654:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526574.694664:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526574.694666:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788526574.694672:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:1.0:1788526574.696583:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788526574.696602:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526574.696613:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526574.696626:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526574.696643:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788526574.696645:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27453b800 from 4 10000000:01000000:1.0:1788526574.696649:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788526574.696688:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526574.696697:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526574.696708:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526574.696742:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526574.696828:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526574.696885:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526574.700503:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513472 00000100:00100000:3.0:1788526574.700520:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513472 00000100:00100000:3.0:1788526574.700743:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788526574.700768:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881513472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526574.700788:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526574.700808:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a285 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526574.700856:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526574.700869:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526574.700879:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54800, rc 0) 00000100:00100000:3.0:1788526574.700961:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526574.700969:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788526574.708493:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526574.708526:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.708540:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526574.709014:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788526574.709574:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526574.709862:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788526574.709910:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788526574.709982:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788526574.709991:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788526574.710069:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.710930:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526574.710985:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242c91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526574.711224:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513600 00000100:00100000:0.0:1788526574.711232:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513600 00000100:00100000:0.0:1788526574.711281:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788526574.711291:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.711565:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526574.711581:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788526574.712889:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.712947:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.713012:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.713035:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b18480 going to sleep for 11 seconds 00000100:00100000:3.0:1788526574.713145:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513728 00000100:00100000:3.0:1788526574.713153:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513728 00000100:00100000:3.0:1788526574.713204:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788526574.713215:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.713493:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526574.713503:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788526574.714053:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788526574.717011:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526574.717147:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513856:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.717737:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526574.717783:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247e60900 going to sleep for 11 seconds 00000100:00100000:3.0:1788526574.721464:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513856 00000100:00100000:3.0:1788526574.721479:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513856 00000100:00100000:3.0:1788526574.721537:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788526574.721548:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513856:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.722044:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513856:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 497us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526574.722054:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788526574.722109:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513856:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788526574.722570:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788526574.722632:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788526574.722684:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788526574.722723:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788526574.722777:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:0.0:1788526574.722833:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513984:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.722896:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.722929:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526574.723262:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881513984 00000100:00100000:3.0:1788526574.723271:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881513984 00000100:00100000:3.0:1788526574.723319:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788526574.723327:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513984:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526574.723533:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881513984:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 206us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526574.723541:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788526574.723588:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881513984:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526574.723696:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788526574.723707:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:3.0:1788526574.725275:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526574.725288:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526574.725291:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788526574.725299:0:8554:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27453b800 00000020:00000080:3.0:1788526574.725301:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526574.725557:0:8554:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526574.725562:0:8554:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526574.725564:0:8554:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788526574.725568:0:8554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:0.0:1788526574.732007:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788526574.732033:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788526574.732046:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.732061:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526574.732075:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788526574.732077:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c248515800 from 4 10000000:01000000:0.0:1788526574.732899:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788526574.732946:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.732969:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526574.732981:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526574.733010:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788526574.733086:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526574.733135:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245b186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.733588:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514112 00000100:00100000:2.0:1788526574.733597:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514112 00000100:00100000:2.0:1788526574.733645:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788526574.733656:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881514112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526574.733671:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526574.733684:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a293 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.733712:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.733724:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.733734:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045e00, rc 0) 00000100:00100000:2.0:1788526574.733782:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881514112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.733789:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788526574.733859:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526574.733878:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.733888:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526574.733931:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.733960:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526574.733981:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27fa9b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.734005:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514240 00000100:00100000:2.0:1788526574.734009:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514240 00000100:00100000:2.0:1788526574.734030:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788526574.734040:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881514240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.734314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881514240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.734322:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788526574.734353:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.734379:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.734441:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526574.734463:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2430bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.734475:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514368 00000100:00100000:2.0:1788526574.734479:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514368 00000100:00100000:2.0:1788526574.734502:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788526574.734509:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881514368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.734657:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881514368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.734663:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788526574.734698:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881514368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526574.734908:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8556:1875405881514496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526574.734946:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526574.734966:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514496 00000100:00100000:2.0:1788526574.734970:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514496 00000100:00100000:2.0:1788526574.734996:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788526574.735002:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:8556:x1875405881514496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526574.735137:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:8556:x1875405881514496:12345-0@lo:502:llog_process_th.0 Request processed in 134us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.735144:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788526574.735174:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2430bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.735206:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8556:1875405881514496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788526574.735227:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526574.735236:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526574.735239:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788526574.735245:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c248515800 00000020:00000080:2.0:1788526574.735247:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788526574.735320:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8556:1875405881514624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526574.735358:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526574.735379:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514624 00000100:00100000:2.0:1788526574.735383:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514624 00000100:00100000:2.0:1788526574.735438:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788526574.735444:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:8556:x1875405881514624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526574.735548:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:8556:x1875405881514624:12345-0@lo:502:llog_process_th.0 Request processed in 103us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526574.735555:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788526574.735593:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2430bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526574.735607:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:8556:1875405881514624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788526574.735626:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526574.735631:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526574.735633:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788526574.735637:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788526574.735691:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788526574.735707:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788526574.735719:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526574.735730:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526574.805621:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526575.258189:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526575.258244:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526575.258283:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526575.258320:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526575.258365:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899072 00000100:00100000:1.0:1788526575.258379:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899072 00000100:00100000:1.0:1788526575.258524:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898944 00000100:00100000:1.0:1788526575.258527:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898944 00000100:00100000:1.0:1788526575.258558:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1788526575.258571:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868899072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526575.258686:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868899072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526575.258693:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1788526575.258715:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1788526575.258722:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868898944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526575.258755:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868898944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526575.258761:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00080000:1.0:1788526575.258784:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526575.258788:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526575.259160:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898816 00000100:00100000:3.0:1788526575.259167:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898816 00000100:00100000:3.0:1788526575.259223:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1788526575.259232:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868898816:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526575.259270:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868898816:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526575.259297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00080000:1.0:1788526575.259358:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526575.261956:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868898688 00000100:00100000:2.0:1788526575.261978:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868898688 00000100:00100000:2.0:1788526575.262158:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:2.0:1788526575.262171:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2351:x1875405868898688:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526575.262274:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2351:x1875405868898688:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 105us (3990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526575.262283:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 206 00010000:00010000:3.0:1788526575.830582:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526576.087297:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881514880:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.087448:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.087537:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881515392:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.087575:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.087617:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788526576.087624:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881514752:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.087657:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.087680:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881515264:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.087713:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.087752:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881515008:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.087779:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.087812:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526576.087819:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881515136:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.088064:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526576.088126:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514880 00000100:00100000:0.0:1788526576.088136:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514880 00000100:00100000:0.0:1788526576.088206:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515264 00000100:00100000:0.0:1788526576.088209:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515264 00000100:00100000:0.0:1788526576.088235:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515008 00000100:00100000:0.0:1788526576.088238:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515008 00000100:00100000:0.0:1788526576.088257:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788526576.088268:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881514880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.088340:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881514880:12345-0@lo:400:kworker.0 Request processed in 74us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526576.088348:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788526576.088368:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788526576.088374:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881515264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.088430:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881515264:12345-0@lo:400:kworker.0 Request processed in 56us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526576.088437:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788526576.088448:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788526576.089011:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526576.089026:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881515520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526576.089069:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526576.089104:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515520 00000100:00100000:3.0:1788526576.089108:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515520 00000100:00100000:3.0:1788526576.089152:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788526576.089160:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881515520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526576.089201:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526576.089241:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881515520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526576.089247:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788526576.089311:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249742300 x1875405881515520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526576.089335:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881515520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526576.090938:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881515008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.091063:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881515008:12345-0@lo:400:kworker.0 Request processed in 141us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526576.091071:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788526576.091122:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515392 00000100:00100000:0.0:1788526576.091130:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515392 00000100:00100000:0.0:1788526576.091171:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515136 00000100:00100000:0.0:1788526576.091175:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515136 00000100:00100000:0.0:1788526576.091205:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788526576.091212:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881515392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.091248:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881515392:12345-0@lo:400:kworker.0 Request processed in 37us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526576.091269:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788526576.091281:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788526576.091286:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881515136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.091318:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881515136:12345-0@lo:400:kworker.0 Request processed in 32us (3254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526576.091323:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788526576.091363:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526576.091368:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526576.091372:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526576.091443:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb72680 x1875405881515136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526576.092759:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881514752 00000100:00100000:2.0:1788526576.092778:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881514752 00000100:00100000:2.0:1788526576.092869:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788526576.092880:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881514752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526576.092985:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881514752:12345-0@lo:400:kworker.0 Request processed in 108us (5327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526576.092993:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788526576.094994:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881515136:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.095052:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881515008:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.095137:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881514752:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.095152:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881515264:0@lo:400:kworker.0 00000100:00100000:0.0:1788526576.095167:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881514880:0@lo:400:kworker.0 00010000:00080000:0.0:1788526576.095188:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb73b80 x1875405881515392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526576.095200:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881515392:0@lo:400:kworker.0 00010000:00010000:2.0:1788526576.851668:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526577.109037:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526577.109072:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881515648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526577.109173:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526577.109294:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515648 00000100:00100000:1.0:1788526577.109305:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515648 00000100:00100000:1.0:1788526577.109366:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526577.109377:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881515648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526577.109452:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526577.109509:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881515648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526577.109516:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788526577.109788:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220380 x1875405881515648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526577.109813:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881515648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788526577.879818:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526578.903253:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526579.926071:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526580.382031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526580.382089:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526580.382122:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526580.382150:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526580.382185:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899456 00000100:00100000:1.0:1788526580.382199:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899456 00000100:00100000:1.0:1788526580.382274:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899584 00000100:00100000:1.0:1788526580.382277:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899584 00000100:00100000:1.0:1788526580.382304:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1788526580.382314:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868899456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526580.382447:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868899456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 134us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526580.382468:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1788526580.382487:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1788526580.382494:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868899584:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526580.382523:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868899584:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526580.382529:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1788526580.382549:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899328 00000100:00100000:1.0:1788526580.382552:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899328 00000100:00100000:1.0:1788526580.382584:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1788526580.382591:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868899328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526580.382619:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868899328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526580.382626:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00080000:1.0:1788526580.382648:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526580.382653:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526580.382655:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526580.384282:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899200 00000100:00100000:3.0:1788526580.384302:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899200 00000100:00100000:3.0:1788526580.384384:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 208 00000100:00100000:3.0:1788526580.384436:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868899200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526580.384518:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868899200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 85us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526580.384527:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 208 00010000:00010000:2.0:1788526580.950377:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526581.209376:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526581.209460:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881515776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526581.209554:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526581.209682:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515776 00000100:00100000:1.0:1788526581.209704:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515776 00000100:00100000:1.0:1788526581.209784:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788526581.209795:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881515776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526581.209840:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526581.209908:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881515776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526581.209916:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788526581.209970:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb75c00 x1875405881515776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526581.210010:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881515776:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788526581.210075:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526581.214232:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881516160:0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.214347:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526581.214422:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526581.214429:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.214454:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526581.214492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516160 00000100:00100000:3.0:1788526581.214502:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516160 00000100:00100000:3.0:1788526581.214568:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516032 00000100:00100000:3.0:1788526581.214571:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516032 00000100:00100000:3.0:1788526581.214594:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788526581.214610:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881516160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.214672:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881516160:12345-0@lo:400:kworker.0 Request processed in 70us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526581.214680:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788526581.214714:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788526581.214721:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881516032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.214749:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881516032:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526581.214755:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788526581.214805:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881516032:0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.214817:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881516160:0@lo:400:kworker.0 00000100:00080000:2.0:1788526581.214924:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526581.214940:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881515904:0@lo:400:kworker.0 00000100:00100000:2.0:1788526581.214982:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526581.215019:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881516416:0@lo:400:kworker.0 00000100:00100000:2.0:1788526581.215044:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526581.215065:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526581.215071:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881516288:0@lo:400:kworker.0 00000100:00100000:2.0:1788526581.215099:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526581.215127:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516416 00000100:00100000:2.0:1788526581.215131:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516416 00000100:00100000:2.0:1788526581.215163:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788526581.215169:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881516416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526581.215204:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881516416:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526581.215211:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788526581.215226:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526581.215244:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881516416:0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.215299:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881515904 00000100:00100000:3.0:1788526581.215304:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881515904 00000100:00100000:3.0:1788526581.215341:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788526581.215349:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881515904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526581.215415:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881515904:12345-0@lo:400:kworker.0 Request processed in 36us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526581.215440:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788526581.215660:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516288 00000100:00100000:1.0:1788526581.215665:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516288 00000100:00100000:1.0:1788526581.215717:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788526581.215724:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881516288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526581.215767:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881516288:12345-0@lo:400:kworker.0 Request processed in 44us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526581.215773:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788526581.215823:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788526581.216090:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2741ee300 x1875405881516288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526581.216104:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881516288:0@lo:400:kworker.0 00000100:00100000:2.0:1788526581.216115:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881515904:0@lo:400:kworker.0 00000001:02000400:2.0:1788526581.603239:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788526581.979556:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526582.227686:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526582.227720:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881516544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526582.227820:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526582.227952:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516544 00000100:00100000:1.0:1788526582.227964:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516544 00000100:00100000:1.0:1788526582.228036:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788526582.228048:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881516544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526582.228101:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526582.228163:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881516544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526582.228170:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788526582.228216:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245223b80 x1875405881516544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526582.228236:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881516544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788526583.003669:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526584.020997:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526585.043578:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526585.501122:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526585.501185:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526585.501257:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899840 00000100:00100000:0.0:1788526585.501271:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899840 00000100:00100000:0.0:1788526585.501365:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1788526585.501413:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868899840:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526585.501514:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868899840:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 129us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526585.501523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00080000:1.0:1788526585.501792:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526585.501981:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899712 00000100:00100000:3.0:1788526585.501986:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899712 00000100:00100000:3.0:1788526585.502036:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:3.0:1788526585.502045:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868899712:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526585.502093:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868899712:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 50us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526585.502100:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:1.0:1788526585.522275:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526585.522419:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868899968 00000100:00100000:0.0:1788526585.522435:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868899968 00000100:00100000:0.0:1788526585.522544:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1788526585.522558:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2347:x1875405868899968:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:0.0:1788526585.522622:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a1ba 00000100:00080000:0.0:1788526585.522637:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788526585.522691:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788526585.523176:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+2:2347:x1875405868899968:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 619us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526585.523186:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00010000:00010000:0.0:1788526585.523214:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526585.523640:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526585.537307:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526585.538111:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900096 00000100:00100000:2.0:1788526585.538126:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900096 00000100:00100000:2.0:1788526585.538223:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526585.538236:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2347:x1875405868900096:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:2.0:1788526585.538306:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a1c1 00000100:00080000:2.0:1788526585.538319:0:6670:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788526585.538369:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788526585.538856:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+2:2347:x1875405868900096:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 621us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526585.538865:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00010000:00010000:2.0:1788526585.538930:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526585.539661:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788526586.074739:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526586.324622:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881516800:0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.324741:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526586.324803:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881517312:0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.324834:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526586.324871:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526586.324878:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.324901:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526586.324944:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516800 00000100:00100000:3.0:1788526586.324955:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516800 00000100:00100000:3.0:1788526586.325027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516928 00000100:00100000:3.0:1788526586.325030:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516928 00000100:00100000:3.0:1788526586.325070:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788526586.325081:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881516800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.325143:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881516800:12345-0@lo:400:kworker.0 Request processed in 64us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526586.325160:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788526586.325183:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526586.325189:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881516928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.325217:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881516928:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526586.325222:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526586.325550:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517312 00000100:00100000:3.0:1788526586.325555:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517312 00000100:00100000:3.0:1788526586.325604:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788526586.325612:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881517312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.325648:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881517312:12345-0@lo:400:kworker.0 Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526586.325655:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788526586.325681:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526586.325687:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526586.325733:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.325745:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881516800:0@lo:400:kworker.0 00010000:00080000:3.0:1788526586.325757:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c249742d80 x1875405881517312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526586.325769:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881517312:0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.325936:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881516672:0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.325980:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526586.326028:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881517184:0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.326056:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526586.326076:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526586.326082:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881517056:0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.326108:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526586.326141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881516672 00000100:00100000:1.0:1788526586.326145:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881516672 00000100:00100000:1.0:1788526586.326176:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788526586.326183:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881516672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.326224:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881516672:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526586.326245:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788526586.326282:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517056 00000100:00100000:1.0:1788526586.326286:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517056 00000100:00100000:1.0:1788526586.326326:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788526586.326334:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881517056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.326365:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881517056:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526586.326371:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788526586.326419:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2741eed80 x1875405881517056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526586.326442:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881517056:0@lo:400:kworker.0 00000100:00100000:1.0:1788526586.326453:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881516672:0@lo:400:kworker.0 00000100:00080000:3.0:1788526586.327566:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526586.327584:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517184 00000100:00100000:3.0:1788526586.327602:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517184 00000100:00100000:3.0:1788526586.327650:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788526586.327658:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881517184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.327743:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881517184:12345-0@lo:400:kworker.0 Request processed in 85us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526586.327751:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788526586.327774:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526586.327803:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881517184:0@lo:400:kworker.0 00000100:00100000:3.0:1788526586.327828:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526586.327837:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881517440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526586.327872:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526586.327904:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517440 00000100:00100000:3.0:1788526586.327907:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517440 00000100:00100000:3.0:1788526586.327934:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788526586.327940:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881517440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526586.327977:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526586.329351:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881517440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1400us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526586.329365:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788526586.330486:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb76680 x1875405881517440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526586.330516:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881517440:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788526586.422938:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:2.0:1788526586.422953:0:6693:0:(genops.c:885:class_export_put()) final put ffff98c27b7b7800/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:2.0:1788526586.422989:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b7b7800/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-OST0000 00000020:00000080:2.0:1788526586.423046:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7b3000 for lustre-OST0000 00010000:00010000:3.0:1788526587.091608:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526587.348158:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881517568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526587.348249:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526587.350426:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517568 00000100:00100000:1.0:1788526587.350440:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517568 00000100:00100000:1.0:1788526587.350511:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788526587.350522:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881517568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526587.350562:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526587.350653:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881517568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526587.350660:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788526587.351822:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211ce00 x1875405881517568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526587.351859:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881517568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788526588.121418:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788526588.801025:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing yml_node 00010000:00010000:1.0:1788526589.140423:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526590.187792:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526590.542173:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:0.0:1788526590.542183:0:7631:0:(genops.c:885:class_export_put()) final put ffff98c27b7b5800/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:0.0:1788526590.542212:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b7b5800/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-OST0001 00000020:00000080:0.0:1788526590.542255:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7b2800 for lustre-OST0001 00000100:00100000:0.0:1788526590.617316:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526590.617376:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526590.617479:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900352 00000100:00100000:1.0:1788526590.617482:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900224 00000100:00100000:2.0:1788526590.617490:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900352 00000100:00100000:1.0:1788526590.617490:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900224 00000100:00100000:2.0:1788526590.617552:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:1.0:1788526590.617562:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:2.0:1788526590.617563:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900352:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526590.617568:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900224:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:0.0:1788526590.617650:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526590.617715:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900352:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 153us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526590.617723:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:1.0:1788526590.625731:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900224:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8148us (8414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526590.625747:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 212 00010000:00010000:3.0:1788526591.187899:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526591.443951:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881518080:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.444028:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526591.444093:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526591.444100:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881517696:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.444130:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526591.444150:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881518208:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.444175:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526591.444201:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881517824:0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444321:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518080 00000100:00100000:3.0:1788526591.444330:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518080 00000100:00100000:3.0:1788526591.444409:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788526591.444421:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881518080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444483:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881518080:12345-0@lo:400:kworker.0 Request processed in 65us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526591.444504:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788526591.444529:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517696 00000100:00100000:3.0:1788526591.444553:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517696 00000100:00100000:3.0:1788526591.444595:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788526591.444602:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881517696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444634:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881517696:12345-0@lo:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526591.444640:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788526591.444671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518208 00000100:00100000:3.0:1788526591.444674:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518208 00000100:00100000:3.0:1788526591.444704:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788526591.444710:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881518208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444742:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881518208:12345-0@lo:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526591.444749:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788526591.444767:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526591.444772:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526591.444807:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881517696:0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444821:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881518208:0@lo:400:kworker.0 00010000:00080000:3.0:1788526591.444833:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb74700 x1875405881518080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526591.444843:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881518080:0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444882:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.444908:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526591.444936:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517952 00000100:00100000:3.0:1788526591.444939:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517952 00000100:00100000:3.0:1788526591.444968:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788526591.444974:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526591.445010:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881517952:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526591.445016:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788526591.445027:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526591.445041:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881517952:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.446130:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526591.446167:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.446193:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526591.446334:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518336 00000100:00100000:0.0:1788526591.446341:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518336 00000100:00100000:0.0:1788526591.446430:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788526591.446440:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881518336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526591.446520:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881518336:12345-0@lo:400:kworker.0 Request processed in 82us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526591.446526:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788526591.446547:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788526591.449343:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb75500 x1875405881518336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526591.449364:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881518336:0@lo:400:kworker.0 00000100:00100000:2.0:1788526591.449406:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526591.449418:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881518464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526591.449486:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526591.449682:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881517824 00000100:00100000:1.0:1788526591.449689:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881517824 00000100:00100000:1.0:1788526591.449741:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788526591.449750:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881517824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526591.449804:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881517824:12345-0@lo:400:kworker.0 Request processed in 55us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526591.449825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788526591.452609:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881517824:0@lo:400:kworker.0 00000100:00100000:0.0:1788526591.453444:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518464 00000100:00100000:0.0:1788526591.453453:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518464 00000100:00100000:0.0:1788526591.453536:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526591.453547:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881518464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526591.453599:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526591.453692:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881518464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526591.453699:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788526591.454311:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb70000 x1875405881518464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526591.454332:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881518464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788526592.212026:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526592.467922:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881518592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526592.468015:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526592.468205:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518592 00000100:00100000:1.0:1788526592.468214:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518592 00000100:00100000:1.0:1788526592.468267:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788526592.468278:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881518592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526592.468313:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526592.468382:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881518592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526592.468425:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788526592.468675:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211f480 x1875405881518592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526592.468695:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881518592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788526593.237634:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788526594.221287:0:9236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:2.0:1788526594.259916:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526595.287336:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526595.740446:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526595.740489:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526595.740601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900608 00000100:00100000:3.0:1788526595.740611:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900608 00000100:00100000:3.0:1788526595.740688:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:3.0:1788526595.740698:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900608:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526595.740773:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900608:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 76us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526595.740780:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00080000:1.0:1788526595.740938:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526595.741317:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900480 00000100:00100000:0.0:1788526595.741322:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900480 00000100:00100000:0.0:1788526595.741485:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:0.0:1788526595.741495:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900480:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526595.741544:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900480:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 51us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526595.741551:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00010000:00010000:2.0:1788526596.308151:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526596.567904:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526596.567929:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881518720:0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.567978:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881518848:0@lo:400:kworker.0 00000100:00100000:2.0:1788526596.568009:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526596.568101:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518720 00000100:00100000:0.0:1788526596.568110:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518720 00000100:00100000:1.0:1788526596.568123:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881519232:0@lo:400:kworker.0 00000100:00100000:0.0:1788526596.568169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788526596.568181:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881518720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.569300:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.569362:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881519360:0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.569437:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.569467:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788526596.569474:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881518976:0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.569495:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.570141:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881519488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526596.570431:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.570489:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519360 00000100:00100000:3.0:1788526596.570496:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519360 00000100:00100000:3.0:1788526596.570628:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788526596.570637:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881519360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.570686:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881519360:12345-0@lo:400:kworker.0 Request processed in 50us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.570693:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788526596.570720:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518848 00000100:00100000:3.0:1788526596.570723:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518848 00000100:00100000:3.0:1788526596.570745:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881518976 00000100:00100000:3.0:1788526596.570748:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881518976 00000100:00100000:3.0:1788526596.570774:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788526596.570780:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881518848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.570812:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881518848:12345-0@lo:400:kworker.0 Request processed in 32us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.570818:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788526596.570830:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788526596.570836:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881518976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.570864:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881518976:12345-0@lo:400:kworker.0 Request processed in 29us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.570869:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788526596.570907:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519488 00000100:00100000:3.0:1788526596.570911:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519488 00000100:00100000:3.0:1788526596.570939:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526596.570992:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881519104:0@lo:400:kworker.0 00000100:00100000:2.0:1788526596.571023:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.571215:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881519488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526596.571244:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526596.571277:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881519488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 332us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.571283:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788526596.571302:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519104 00000100:00100000:3.0:1788526596.571305:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519104 00000100:00100000:3.0:1788526596.571330:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526596.571336:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.571364:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881519104:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.571370:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788526596.571420:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526596.571425:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526596.571427:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526596.571461:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881518976:0@lo:400:kworker.0 00010000:00080000:3.0:1788526596.571475:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb71180 x1875405881519488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526596.571493:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881519488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526596.571504:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881518848:0@lo:400:kworker.0 00010000:00080000:3.0:1788526596.571531:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1422c6300 x1875405881519360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526596.571540:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881519360:0@lo:400:kworker.0 00010000:00080000:2.0:1788526596.571552:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1422c7800 x1875405881519104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526596.571566:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881519104:0@lo:400:kworker.0 00000100:00100000:1.0:1788526596.572885:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526596.573176:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519232 00000100:00100000:3.0:1788526596.573184:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519232 00000100:00100000:3.0:1788526596.573277:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788526596.573287:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881519232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526596.573338:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881519232:12345-0@lo:400:kworker.0 Request processed in 54us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526596.573346:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788526596.573495:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526596.573526:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881519232:0@lo:400:kworker.0 00000100:00100000:0.0:1788526596.579847:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881518720:12345-0@lo:400:kworker.0 Request processed in 11659us (11829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526596.579863:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788526596.579931:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881518720:0@lo:400:kworker.0 00010000:00010000:0.0:1788526597.332703:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788526597.459072:0:9333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00000100:00100000:2.0:1788526597.591307:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526597.591351:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881519616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526597.591472:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526597.591510:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519616 00000100:00100000:3.0:1788526597.591520:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519616 00000100:00100000:2.0:1788526597.591579:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788526597.591588:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881519616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526597.591626:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526597.591681:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881519616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526597.591688:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788526597.591885:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1422c6300 x1875405881519616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526597.591905:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881519616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788526598.356685:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526599.380290:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788526600.248598:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:2.0:1788526600.403712:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526600.857837:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526600.857952:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526600.858059:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900864 00000100:00100000:3.0:1788526600.858077:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900864 00000100:00100000:3.0:1788526600.858191:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1788526600.858203:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526600.858324:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868900864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526600.858333:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1788526600.858630:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900736 00000100:00100000:0.0:1788526600.858642:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900736 00000100:00080000:1.0:1788526600.859064:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526600.859123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:0.0:1788526600.859137:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526600.860383:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1245us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526600.860418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 216 00010000:00010000:2.0:1788526601.431265:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526601.685993:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881519744:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686157:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686207:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881520256:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686238:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686265:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526601.686299:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881520128:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686328:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686358:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881519872:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686380:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686419:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881520384:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686441:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686457:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526601.686463:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881520000:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686485:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526601.686518:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520256 00000100:00100000:3.0:1788526601.686526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520256 00000100:00100000:3.0:1788526601.686581:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519872 00000100:00100000:3.0:1788526601.686584:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519872 00000100:00100000:3.0:1788526601.686595:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520000 00000100:00100000:3.0:1788526601.686597:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520000 00000100:00100000:3.0:1788526601.686611:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788526601.686631:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881520256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686686:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881520256:12345-0@lo:400:kworker.0 Request processed in 68us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526601.686693:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788526601.686711:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788526601.686717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881519872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686745:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881519872:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526601.686750:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788526601.686760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788526601.686765:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881520000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686794:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881520000:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526601.686799:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788526601.686817:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520128 00000100:00100000:3.0:1788526601.686820:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520128 00000100:00100000:3.0:1788526601.686842:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520384 00000100:00100000:3.0:1788526601.686844:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520384 00000100:00100000:3.0:1788526601.686860:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788526601.686867:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881520128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686895:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881520128:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526601.686902:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788526601.686913:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788526601.686918:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881520384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.686943:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881520384:12345-0@lo:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526601.686948:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788526601.686973:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526601.686977:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526601.686979:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526601.687153:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881520000:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.687169:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881519872:0@lo:400:kworker.0 00010000:00080000:3.0:1788526601.687181:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211d500 x1875405881520384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526601.687197:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881520384:0@lo:400:kworker.0 00010000:00080000:3.0:1788526601.687243:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211df80 x1875405881520128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526601.687252:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881520128:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.687262:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881520256:0@lo:400:kworker.0 00000100:00100000:3.0:1788526601.687448:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881520512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526601.687481:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526601.687553:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520512 00000100:00100000:2.0:1788526601.687557:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520512 00000100:00100000:2.0:1788526601.687595:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526601.687602:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881520512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526601.687707:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526601.687745:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881520512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526601.687752:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788526601.687816:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb74700 x1875405881520512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526601.687832:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881520512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526601.690004:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881519744 00000100:00100000:2.0:1788526601.690096:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881519744 00000100:00100000:2.0:1788526601.690151:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788526601.690160:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881519744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526601.690248:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881519744:12345-0@lo:400:kworker.0 Request processed in 89us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526601.690255:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788526601.690412:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881519744:0@lo:400:kworker.0 00000001:02000400:3.0:1788526602.023351:0:9479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 08:56:39 EDT 2026 00010000:00010000:0.0:1788526602.451653:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526602.707694:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526602.707729:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881520640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526602.707843:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526602.707954:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520640 00000100:00100000:3.0:1788526602.707964:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520640 00000100:00100000:3.0:1788526602.708026:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526602.708037:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881520640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526602.708085:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526602.708139:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881520640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526602.708147:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788526602.708205:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c1422c5f80 x1875405881520640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526602.708242:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881520640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788526603.475555:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526604.502970:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526605.523763:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526605.978262:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526605.978330:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526605.978348:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868900992 00000100:00100000:3.0:1788526605.978370:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868900992 00000100:00100000:3.0:1788526605.978501:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:3.0:1788526605.978515:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526605.978625:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2350:x1875405868900992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526605.978633:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:2.0:1788526605.978999:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901120 00000100:00100000:2.0:1788526605.979007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901120 00000100:00100000:2.0:1788526605.979062:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1788526605.979071:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868901120:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526605.979109:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868901120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526605.979115:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00080000:3.0:1788526605.979444:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788526606.550875:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526606.803779:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526606.803813:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881520768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526606.803921:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526606.803998:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520768 00000100:00100000:0.0:1788526606.804013:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520768 00000100:00100000:2.0:1788526606.804022:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881521152:0@lo:400:kworker.0 00000100:00100000:2.0:1788526606.804071:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526606.804102:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526606.804112:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881521280:0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.804124:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788526606.804141:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881520768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526606.804156:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788526606.804209:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526606.804314:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881520768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526606.804322:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788526606.804638:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881520896:0@lo:400:kworker.0 00010000:00080000:2.0:1788526606.804658:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb77100 x1875405881520768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526606.804687:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881520768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526606.804704:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526606.804748:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881521408:0@lo:400:kworker.0 00000100:00100000:2.0:1788526606.804758:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521152 00000100:00100000:2.0:1788526606.804765:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521152 00000100:00100000:3.0:1788526606.804779:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526606.804814:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788526606.804816:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521408 00000100:00100000:2.0:1788526606.804822:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521408 00000100:00100000:3.0:1788526606.804826:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881521024:0@lo:400:kworker.0 00000100:00100000:2.0:1788526606.804859:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788526606.804870:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881521152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526606.804883:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526606.804904:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881521536:0@lo:400:kworker.0 00000100:00100000:3.0:1788526606.805188:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526606.805257:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521280 00000100:00100000:3.0:1788526606.805264:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521280 00000100:00100000:3.0:1788526606.805316:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521536 00000100:00100000:3.0:1788526606.805320:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521536 00000100:00100000:3.0:1788526606.805355:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788526606.805375:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526606.805477:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881521280:12345-0@lo:400:kworker.0 Request processed in 102us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526606.805485:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788526606.805511:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788526606.805520:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526606.805572:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881521536:12345-0@lo:400:kworker.0 Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526606.805579:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788526606.805608:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881520896 00000100:00100000:3.0:1788526606.805613:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881520896 00000100:00100000:3.0:1788526606.805652:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788526606.805658:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881520896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.805695:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521024 00000100:00100000:0.0:1788526606.805704:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521024 00000100:00100000:0.0:1788526606.805734:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788526606.805743:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881521408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.805801:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881521408:12345-0@lo:400:kworker.0 Request processed in 59us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526606.805825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788526606.805841:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788526606.805848:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881521024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.805879:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881521024:12345-0@lo:400:kworker.0 Request processed in 32us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526606.805885:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788526606.805939:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526606.805946:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788526606.805948:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788526606.805982:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb70e00 x1875405881521280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526606.805995:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881521280:0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.806008:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881521152:0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.806063:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881521024:0@lo:400:kworker.0 00010000:00080000:0.0:1788526606.806078:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb70380 x1875405881521536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526606.806086:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881521536:0@lo:400:kworker.0 00000100:00100000:0.0:1788526606.806099:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881521408:0@lo:400:kworker.0 00000100:00100000:3.0:1788526606.809479:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881520896:12345-0@lo:400:kworker.0 Request processed in 3807us (4765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526606.809505:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788526606.810594:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881520896:0@lo:400:kworker.0 00000100:00100000:2.0:1788526606.820353:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881521152:12345-0@lo:400:kworker.0 Request processed in 15469us (16264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526606.820374:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:2.0:1788526607.571916:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526607.827937:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881521664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526607.828042:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526607.828168:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521664 00000100:00100000:0.0:1788526607.828188:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521664 00000100:00100000:0.0:1788526607.828262:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788526607.828273:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881521664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526607.828340:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526607.828435:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881521664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526607.828443:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788526607.829042:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb73800 x1875405881521664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526607.829065:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881521664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788526608.600134:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526609.623876:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526610.643580:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526611.113355:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526611.113448:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526611.113552:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901376 00000100:00100000:3.0:1788526611.113566:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901376 00000100:00100000:3.0:1788526611.113668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1788526611.113681:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868901376:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526611.113784:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868901376:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526611.113793:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1788526611.113978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901248 00000100:00100000:1.0:1788526611.113984:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901248 00000100:00100000:1.0:1788526611.114023:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:1.0:1788526611.114048:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868901248:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526611.114089:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868901248:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 43us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526611.114096:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00080000:0.0:1788526611.114216:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526611.670694:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526611.925502:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881521792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526611.925609:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526611.925742:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521792 00000100:00100000:3.0:1788526611.925752:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521792 00000100:00100000:3.0:1788526611.925826:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788526611.925837:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881521792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526611.925881:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526611.925933:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881521792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526611.925940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788526611.925966:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788526611.926002:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2741ef480 x1875405881521792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526611.926026:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881521792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526611.951582:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881521920:0@lo:400:kworker.0 00000100:00100000:1.0:1788526611.951683:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526611.951800:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881522048:0@lo:400:kworker.0 00000100:00100000:1.0:1788526611.951834:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526611.951879:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522048 00000100:00100000:1.0:1788526611.951889:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522048 00000100:00100000:1.0:1788526611.951965:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788526611.951976:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881522048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526611.952038:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881522048:12345-0@lo:400:kworker.0 Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526611.952046:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788526611.952109:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881522048:0@lo:400:kworker.0 00000100:00100000:1.0:1788526611.952181:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881522432:0@lo:400:kworker.0 00000100:00100000:1.0:1788526611.952206:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526611.956361:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881521920 00000100:00100000:3.0:1788526611.956408:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881521920 00000100:00100000:3.0:1788526611.956483:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788526611.956495:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881521920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.956621:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881521920:12345-0@lo:400:kworker.0 Request processed in 129us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526611.956629:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788526611.956674:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522432 00000100:00100000:3.0:1788526611.956679:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522432 00000100:00100000:3.0:1788526611.957485:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788526611.957497:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881522432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.957550:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881522432:12345-0@lo:400:kworker.0 Request processed in 56us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526611.957556:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788526611.957617:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881522432:0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.957649:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881521920:0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.957702:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881522176:0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.957853:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526611.957889:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526611.957896:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881522304:0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.957926:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526611.959330:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522304 00000100:00100000:3.0:1788526611.959347:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522304 00000100:00100000:3.0:1788526611.959444:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788526611.959454:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881522304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526611.959551:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881522304:12345-0@lo:400:kworker.0 Request processed in 98us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526611.959559:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788526611.959610:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211dc00 x1875405881522304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526611.959627:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881522304:0@lo:400:kworker.0 00000100:00080000:3.0:1788526611.959661:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526611.959667:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526611.960341:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522176 00000100:00100000:0.0:1788526611.960351:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522176 00000100:00100000:0.0:1788526611.960428:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788526611.960435:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2741ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881522176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526611.960491:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2741ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881522176:12345-0@lo:400:kworker.0 Request processed in 57us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526611.960498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788526611.962934:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881522176:0@lo:400:kworker.0 00000100:00080000:3.0:1788526611.963013:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526612.696872:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526612.958237:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881522560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526612.958335:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526612.958543:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522560 00000100:00100000:3.0:1788526612.958555:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522560 00000100:00100000:3.0:1788526612.958631:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788526612.958642:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881522560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526612.958698:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526612.958780:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881522560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526612.958788:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788526612.958841:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2741ee300 x1875405881522560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526612.958875:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881522560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788526613.715550:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526614.739661:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526615.763725:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526616.219769:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526616.219827:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526616.220035:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901632 00000100:00100000:3.0:1788526616.220049:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901632 00000100:00100000:3.0:1788526616.220151:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1788526616.220164:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868901632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526616.220268:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868901632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 107us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526616.220277:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1788526616.220667:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901504 00000100:00100000:2.0:1788526616.220674:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901504 00000100:00100000:2.0:1788526616.220710:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:2.0:1788526616.220718:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868901504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526616.220772:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868901504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 54us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526616.220780:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00080000:1.0:1788526616.221312:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788526616.795556:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526617.044808:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881522816:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.044920:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.044989:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881523328:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045035:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.045073:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788526617.045080:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881522688:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045114:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.045135:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881523200:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045158:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.045204:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881522944:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045234:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.045256:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788526617.045262:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881523072:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045286:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526617.045325:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522816 00000100:00100000:0.0:1788526617.045336:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522816 00000100:00100000:0.0:1788526617.045422:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523200 00000100:00100000:0.0:1788526617.045426:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523200 00000100:00100000:0.0:1788526617.045460:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522944 00000100:00100000:0.0:1788526617.045463:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522944 00000100:00100000:0.0:1788526617.045484:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788526617.045495:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881522816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045557:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881522816:12345-0@lo:400:kworker.0 Request processed in 64us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045565:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788526617.045585:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788526617.045592:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881523200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045619:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881523200:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788526617.045636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788526617.045643:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881522944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045675:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881522944:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788526617.045701:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523328 00000100:00100000:0.0:1788526617.045713:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523328 00000100:00100000:0.0:1788526617.045745:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523072 00000100:00100000:0.0:1788526617.045748:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523072 00000100:00100000:0.0:1788526617.045768:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788526617.045775:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881523328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045808:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881523328:12345-0@lo:400:kworker.0 Request processed in 34us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045815:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788526617.045826:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788526617.045832:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881523072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045857:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881523072:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045863:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788526617.045883:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881522688 00000100:00100000:0.0:1788526617.045887:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881522688 00000100:00100000:0.0:1788526617.045916:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788526617.045922:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881522688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.045951:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881522688:12345-0@lo:400:kworker.0 Request processed in 30us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526617.045958:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1788526617.046018:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526617.046024:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526617.046027:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526617.046075:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb70e00 x1875405881523072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526617.046092:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881523072:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.046106:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881522944:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.046150:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881522688:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.046161:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881523200:0@lo:400:kworker.0 00000100:00100000:0.0:1788526617.046174:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881522816:0@lo:400:kworker.0 00010000:00080000:0.0:1788526617.046185:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb71180 x1875405881523328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526617.046193:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881523328:0@lo:400:kworker.0 00000100:00100000:1.0:1788526617.048806:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526617.048834:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881523456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526617.049076:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526617.050467:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523456 00000100:00100000:3.0:1788526617.050482:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523456 00000100:00100000:3.0:1788526617.050557:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788526617.050568:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881523456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526617.050620:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526617.052821:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881523456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2243us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526617.052835:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788526617.052950:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211c700 x1875405881523456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526617.052980:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881523456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788526617.811521:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526618.067710:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526618.067745:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881523584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526618.067871:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526618.067955:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523584 00000100:00100000:3.0:1788526618.067965:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523584 00000100:00100000:3.0:1788526618.068036:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788526618.068046:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881523584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526618.068095:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526618.068339:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881523584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 293us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526618.068347:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788526618.068434:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2741ee300 x1875405881523584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526618.069197:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2741ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881523584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788526618.835611:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526619.859678:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526620.884148:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526621.344522:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526621.344585:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901888 00000100:00100000:1.0:1788526621.344595:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526621.344597:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901888 00000100:00100000:0.0:1788526621.344693:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1788526621.344703:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868901760 00000100:00100000:0.0:1788526621.344705:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868901888:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526621.344710:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868901760 00000100:00100000:3.0:1788526621.344750:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:3.0:1788526621.344772:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868901760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526621.344797:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868901888:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526621.344809:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1788526621.344810:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868901760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 50us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526621.344820:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00080000:2.0:1788526621.344903:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788526621.914741:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526622.164804:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526622.164849:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881523712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526622.164955:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526622.165052:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523712 00000100:00100000:1.0:1788526622.165063:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523712 00000100:00100000:1.0:1788526622.165138:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788526622.165150:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881523712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526622.165201:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526622.165257:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881523712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526622.165265:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788526622.165289:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788526622.165334:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211e300 x1875405881523712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526622.165354:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881523712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526622.168786:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881524224:0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.168906:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526622.168966:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526622.168973:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881523840:0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.169005:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526622.169113:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881524352:0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.169143:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526622.169184:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523840 00000100:00100000:2.0:1788526622.169195:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523840 00000100:00100000:2.0:1788526622.169251:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788526622.169261:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881523840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.169320:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881523840:12345-0@lo:400:kworker.0 Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526622.169329:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788526622.169371:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524352 00000100:00100000:2.0:1788526622.169375:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524352 00000100:00100000:2.0:1788526622.169443:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788526622.169450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881524352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.169481:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881524352:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526622.169489:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788526622.169542:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881523840:0@lo:400:kworker.0 00000100:00100000:2.0:1788526622.169558:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881524352:0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.169920:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881524096:0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.169967:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526622.170017:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526622.170025:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881523968:0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.170057:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526622.170090:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524096 00000100:00100000:1.0:1788526622.170095:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524096 00000100:00100000:1.0:1788526622.170127:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881523968 00000100:00100000:1.0:1788526622.170139:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881523968 00000100:00100000:1.0:1788526622.170162:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788526622.170169:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881524096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.170210:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881524096:12345-0@lo:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526622.170217:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788526622.170231:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788526622.170238:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881523968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.170264:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881523968:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526622.170270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788526622.170289:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526622.170313:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881523968:0@lo:400:kworker.0 00000100:00100000:1.0:1788526622.170325:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881524096:0@lo:400:kworker.0 00000100:00100000:0.0:1788526622.170711:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524224 00000100:00100000:0.0:1788526622.170718:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524224 00000100:00100000:0.0:1788526622.170765:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788526622.170772:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881524224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788526622.170921:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526622.172072:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881524224:12345-0@lo:400:kworker.0 Request processed in 1291us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526622.172084:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788526622.172227:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f7b80 x1875405881524224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526622.172243:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881524224:0@lo:400:kworker.0 00000001:02000400:0.0:1788526622.425097:0:10108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:56:59 (1788526619) === 00010000:00010000:0.0:1788526622.932024:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526623.069257:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.069367:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902016 00000100:00100000:0.0:1788526623.069379:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902016 00000100:00100000:0.0:1788526623.069496:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:0.0:1788526623.069508:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+10:8124:x1875405868902016:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526623.069537:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526623.069555:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821000/0x367645d450b3a2a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59318 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.069586:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821000/0x367645d450b3a2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59318 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.069599:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821000/0x367645d450b3a2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59318 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.069609:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821000, rc 0) 00000100:00100000:0.0:1788526623.069683:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+11:8124:x1875405868902016:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 177us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.069691:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:0.0:1788526623.091125:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.093928:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902144 00000100:00100000:3.0:1788526623.093949:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902144 00000100:00100000:3.0:1788526623.094044:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:3.0:1788526623.094057:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+11:8124:x1875405868902144:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788526623.094375:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+11:8124:x1875405868902144:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 320us (3261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788526623.094383:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:1.0:1788526623.099510:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.099622:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902272 00000100:00100000:2.0:1788526623.099634:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902272 00000100:00100000:2.0:1788526623.099709:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:2.0:1788526623.099720:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+11:8124:x1875405868902272:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788526623.099746:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526623.099766:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282045200/0x367645d450b3a2a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5931f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.099796:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282045200/0x367645d450b3a2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5931f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.099809:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282045200/0x367645d450b3a2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5931f expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.099819:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045200, rc 0) 00000100:00100000:2.0:1788526623.099890:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902272:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 172us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.099897:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:1.0:1788526623.103147:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.103293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902400 00000100:00100000:3.0:1788526623.103305:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902400 00000100:00100000:3.0:1788526623.103363:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:3.0:1788526623.103374:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902400:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788526623.104326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902400:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 948us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.104336:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:1.0:1788526623.110893:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.111120:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902528 00000100:00100000:0.0:1788526623.111134:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902528 00000100:00100000:0.0:1788526623.111197:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:0.0:1788526623.111209:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902528:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788526623.111508:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902528:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 300us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.111516:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:1.0:1788526623.126288:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.127461:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902656 00000100:00100000:2.0:1788526623.127476:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902656 00000100:00100000:2.0:1788526623.127549:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:2.0:1788526623.127559:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+12:8128:x1875405868902656:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788526623.128176:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+12:8128:x1875405868902656:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 616us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.128186:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:2.0:1788526623.156959:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.157650:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902784 00000100:00100000:0.0:1788526623.157661:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902784 00000100:00100000:0.0:1788526623.157752:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:0.0:1788526623.157763:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+12:8128:x1875405868902784:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526623.158104:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+12:8128:x1875405868902784:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 342us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.158112:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:1.0:1788526623.162307:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.162448:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868902912 00000100:00100000:2.0:1788526623.162461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868902912 00000100:00100000:2.0:1788526623.162510:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:2.0:1788526623.162520:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+12:8124:x1875405868902912:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788526623.162544:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526623.162561:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c282044800/0x367645d450b3a2af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59349 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.162592:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c282044800/0x367645d450b3a2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59349 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.162604:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c282044800/0x367645d450b3a2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59349 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526623.162613:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044800, rc 0) 00000100:00100000:2.0:1788526623.162681:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:8124:x1875405868902912:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 162us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.162688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:3.0:1788526623.196945:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.196984:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903040 00000100:00100000:3.0:1788526623.196994:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903040 00000100:00100000:3.0:1788526623.197050:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1788526623.197061:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:8124:x1875405868903040:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788526623.197092:0:5815:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788526623.197131:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788526623.197137:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788526623.197141:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788526623.197144:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788526623.197563:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526623.197583:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526623.197633:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526623.198476:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524480 00000100:00100000:3.0:1788526623.198485:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524480 00000100:00100000:3.0:1788526623.198544:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788526623.198554:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881524480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526623.198590:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526623.198714:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881524480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.199976:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788526623.201494:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:8124:x1875405868903040:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 4420us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.201512:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1788526623.205367:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.205822:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903168 00000100:00100000:0.0:1788526623.205836:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903168 00000100:00100000:0.0:1788526623.205916:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 235 00000100:00100000:0.0:1788526623.205927:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:8124:x1875405868903168:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526623.205952:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526623.205976:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59350 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.206012:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.206042:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 14 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526623.206055:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821c00, rc 0) 00000100:00100000:0.0:1788526623.206139:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:8124:x1875405868903168:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 213us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.206147:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 235 00010000:00080000:2.0:1788526623.208640:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469f100 x1875405881524480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526623.208720:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526623.212357:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.213448:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903296 00000100:00100000:3.0:1788526623.213467:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903296 00000100:00100000:3.0:1788526623.213568:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:3.0:1788526623.213581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:8124:x1875405868903296:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788526623.213985:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:8124:x1875405868903296:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 405us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.213996:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:1.0:1788526623.219630:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.219903:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903424 00000100:00100000:3.0:1788526623.219916:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903424 00000100:00100000:3.0:1788526623.220049:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:3.0:1788526623.220062:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:8124:x1875405868903424:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788526623.220425:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:8124:x1875405868903424:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 364us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.220435:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:1.0:1788526623.226959:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.227644:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903552 00000100:00100000:0.0:1788526623.227675:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903552 00000100:00100000:0.0:1788526623.227769:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:0.0:1788526623.227783:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:8131:x1875405868903552:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526623.228182:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:8131:x1875405868903552:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 402us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.228192:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:1.0:1788526623.235794:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.235983:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903680 00000100:00100000:3.0:1788526623.236007:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903680 00000100:00100000:3.0:1788526623.236088:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:3.0:1788526623.236101:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:8131:x1875405868903680:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788526623.236486:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:8131:x1875405868903680:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 387us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526623.236503:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:1.0:1788526623.243279:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.244060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903808 00000100:00100000:2.0:1788526623.244079:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903808 00000100:00100000:2.0:1788526623.244155:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1788526623.244165:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875405868903808:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788526623.244199:0:5823:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5@192.168.204.59@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788526623.244240:0:5823:0:(genops.c:1385:class_connect()) connect: client 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5, cookie 0x367645d450b3a2bd 00000004:00100000:2.0:1788526623.244281:0:5823:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788526623.244650:0:5823:0:(import.c:65:import_set_state_nolock()) ffff98c27b670800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526623.245008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2347:x1875405868903808:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 842us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.245017:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526623.247789:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.249114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904192 00000100:00100000:2.0:1788526623.249130:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904192 00000100:00100000:2.0:1788526623.249215:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:2.0:1788526623.249225:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868904192:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:3.0:1788526623.249459:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526623.249817:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868904192:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 517us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.249827:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1788526623.251986:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.252085:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868903936 00000100:00100000:2.0:1788526623.252711:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868903936 00000100:00100000:2.0:1788526623.252844:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526623.252857:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:0:x1875405868903936:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788526623.252919:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788526623.252970:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526623.253154:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:0:x1875405868903936:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 298us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.253162:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526623.262942:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526623.264012:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904064 00000100:00100000:1.0:1788526623.264042:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904064 00000100:00100000:1.0:1788526623.264138:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526623.264151:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904064:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788526623.264199:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788526623.264320:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904064:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 171us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526623.264329:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1788526623.267214:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526623.267451:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904320 00000100:00100000:2.0:1788526623.267465:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904320 00000100:00100000:2.0:1788526623.267550:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1788526623.267562:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904320:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788526623.267677:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904320:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 117us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526623.267685:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526623.272438:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.272486:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526623.272599:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526623.272662:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904704 00000100:00100000:0.0:1788526623.272678:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904704 00000100:00100000:0.0:1788526623.272759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526623.272772:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904704:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788526623.272890:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788526623.273008:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:8124:x1875405868904704:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 238us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526623.273017:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1788526623.307635:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904448 00000100:00100000:1.0:1788526623.307660:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904448 00000100:00100000:1.0:1788526623.307765:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904576 00000100:00100000:1.0:1788526623.307769:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904576 00000100:00100000:1.0:1788526623.307800:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526623.307810:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875405868904448:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788526623.307858:0:6671:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5@192.168.204.59@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:1.0:1788526623.307913:0:6671:0:(genops.c:1385:class_connect()) connect: client 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5, cookie 0x367645d450b3a2c4 00002000:00100000:1.0:1788526623.307932:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5/ffff98c26e9e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788526623.307947:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788526623.308659:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788526623.308818:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526623.308921:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2347:x1875405868904448:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 1110us (36432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526623.308931:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526623.308957:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1788526623.308962:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875405868904576:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788526623.309985:0:6671:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5@192.168.204.59@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:1.0:1788526623.310238:0:6671:0:(genops.c:1385:class_connect()) connect: client 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5, cookie 0x367645d450b3a2cb 00002000:00100000:1.0:1788526623.310255:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5/ffff98c26e9e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788526623.310271:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788526623.310599:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788526623.310635:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526623.318892:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2347:x1875405868904576:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 9897us (46261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526623.318911:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:2.0:1788526623.955696:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526624.983667:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788526625.318800:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00010000:00010000:1.0:1788526626.009766:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526626.419487:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00010000:00010000:0.0:1788526627.029264:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526627.287154:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788526627.287186:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881524608:0@lo:400:kworker.0 00000100:00100000:1.0:1788526627.287226:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881524736:0@lo:400:kworker.0 00000100:00100000:2.0:1788526627.287292:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881525120:0@lo:400:kworker.0 00000100:00100000:3.0:1788526627.287330:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881524864:0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.291448:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526627.297132:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524608 00000100:00100000:3.0:1788526627.297156:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524608 00000100:00100000:1.0:1788526627.297509:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526627.297887:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526627.297952:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881525376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526627.298026:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526627.298080:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524736 00000100:00100000:1.0:1788526627.298087:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524736 00000100:00100000:1.0:1788526627.298141:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524864 00000100:00100000:1.0:1788526627.298145:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524864 00000100:00100000:1.0:1788526627.298181:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788526627.298192:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881524736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526627.298266:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881524736:12345-0@lo:400:kworker.0 Request processed in 76us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526627.298275:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788526627.298293:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788526627.298311:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881524864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.298557:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881524992:0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.298691:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526627.298725:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881524992 00000100:00100000:0.0:1788526627.298730:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881524992 00000100:00100000:0.0:1788526627.298767:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788526627.298775:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881524992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.298831:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881524992:12345-0@lo:400:kworker.0 Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526627.298839:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788526627.298883:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b085c00 x1875405881524992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526627.298901:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881524992:0@lo:400:kworker.0 00000100:00100000:2.0:1788526627.299008:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526627.299142:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788526627.299150:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881524608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526627.299189:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881524608:12345-0@lo:400:kworker.0 Request processed in 40us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526627.299195:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788526627.299520:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525120 00000100:00100000:0.0:1788526627.299527:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525120 00000100:00100000:0.0:1788526627.299554:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788526627.299561:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.300011:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881525120:12345-0@lo:400:kworker.0 Request processed in 446us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526627.300019:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788526627.307884:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881524864:12345-0@lo:400:kworker.0 Request processed in 9556us (9979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526627.307906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788526627.307969:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525376 00000100:00100000:1.0:1788526627.307981:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525376 00000100:00100000:1.0:1788526627.308041:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788526627.308050:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881525376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526627.308093:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526627.308134:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881525376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (10108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526627.308141:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788526627.308163:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526627.308168:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526627.308172:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526627.308254:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881524864:0@lo:400:kworker.0 00010000:00080000:1.0:1788526627.308275:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469ed80 x1875405881525376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526627.308295:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881525376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526627.308509:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881525120:0@lo:400:kworker.0 00000100:00100000:0.0:1788526627.308703:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881524608:0@lo:400:kworker.0 00000100:00100000:1.0:1788526627.310886:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881524736:0@lo:400:kworker.0 00000100:00100000:1.0:1788526627.310907:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881525248:0@lo:400:kworker.0 00000100:00100000:1.0:1788526627.310992:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526627.313904:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525248 00000100:00100000:2.0:1788526627.313933:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525248 00000100:00100000:2.0:1788526627.314010:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788526627.314027:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881525248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526627.314151:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881525248:12345-0@lo:400:kworker.0 Request processed in 127us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526627.314173:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788526627.314347:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b084a80 x1875405881525248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526627.314367:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881525248:0@lo:400:kworker.0 00000001:00100000:1.0:1788526627.340298:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00010000:00010000:2.0:1788526628.058790:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526628.308034:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881525504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526628.308120:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526628.308376:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525504 00000100:00100000:1.0:1788526628.308416:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525504 00000100:00100000:1.0:1788526628.308482:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788526628.308491:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881525504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526628.308530:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526628.313522:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881525504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5019us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526628.313539:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788526628.318132:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469ca80 x1875405881525504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526628.318227:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881525504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526628.504283:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526628.504816:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526628.504869:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526628.504900:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526628.504928:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526628.504960:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905088 00000100:00100000:3.0:1788526628.504971:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905088 00000100:00100000:3.0:1788526628.505034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904960 00000100:00100000:3.0:1788526628.505038:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904960 00000100:00100000:3.0:1788526628.505061:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:3.0:1788526628.505069:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905088:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526628.505142:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905088:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526628.505149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:3.0:1788526628.505168:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1788526628.505194:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868904960:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526628.505222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868904960:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526628.505228:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1788526628.505247:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905344 00000100:00100000:3.0:1788526628.505251:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905344 00000100:00100000:3.0:1788526628.505277:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905216 00000100:00100000:3.0:1788526628.505279:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905216 00000100:00100000:3.0:1788526628.505298:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1788526628.505304:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905344:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526628.505346:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905344:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526628.505353:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1788526628.505363:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1788526628.505369:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905216:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526628.505413:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868905216:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 44us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526628.505419:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00080000:3.0:1788526628.505435:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526628.505440:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526628.505442:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526628.511795:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868904832 00000100:00100000:0.0:1788526628.511813:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868904832 00000100:00100000:0.0:1788526628.512632:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:0.0:1788526628.512648:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868904832:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526628.512984:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868904832:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 340us (8709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526628.513008:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 241 00010000:00010000:1.0:1788526629.076584:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526630.101953:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788526630.509610:0:10306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788526631.124185:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526632.149600:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526632.407478:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788526632.407580:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526632.407651:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788526632.407658:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881525632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526632.407689:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526632.407742:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881526144:0@lo:400:kworker.0 00000100:00100000:0.0:1788526632.407776:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526632.407806:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881525888:0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.407927:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881525760:0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.407965:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526632.408009:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881526272:0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.408033:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526632.408095:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525760 00000100:00100000:3.0:1788526632.408105:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525760 00000100:00100000:3.0:1788526632.408166:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788526632.408177:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881525760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.408256:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881525760:12345-0@lo:400:kworker.0 Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526632.408266:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788526632.408313:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526016 00000100:00100000:3.0:1788526632.408317:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526016 00000100:00100000:3.0:1788526632.408358:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526272 00000100:00100000:3.0:1788526632.408361:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526272 00000100:00100000:3.0:1788526632.408403:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788526632.408412:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881526016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.408453:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881526016:12345-0@lo:400:kworker.0 Request processed in 43us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526632.408460:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788526632.408472:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788526632.408478:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881526272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.408503:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881526272:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526632.408509:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788526632.408526:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526632.408566:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881525760:0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.408583:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881526272:0@lo:400:kworker.0 00000100:00100000:0.0:1788526632.408795:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526632.408886:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881526400:0@lo:400:kworker.0 00000100:00100000:0.0:1788526632.408914:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526632.408999:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525888 00000100:00100000:3.0:1788526632.409003:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525888 00000100:00100000:3.0:1788526632.409026:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788526632.409032:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881525888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526632.409066:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881525888:12345-0@lo:400:kworker.0 Request processed in 34us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526632.409072:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788526632.413555:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526144 00000100:00100000:1.0:1788526632.413581:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526144 00000100:00100000:1.0:1788526632.413663:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526400 00000100:00100000:1.0:1788526632.413667:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526400 00000100:00100000:1.0:1788526632.413727:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788526632.413740:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526632.413884:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e678850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881526144:12345-0@lo:400:kworker.0 Request processed in 146us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526632.413893:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788526632.414113:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788526632.414122:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881526400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526632.414158:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881526400:12345-0@lo:400:kworker.0 Request processed in 38us (5243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526632.414164:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788526632.414186:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881525632 00000100:00100000:1.0:1788526632.414191:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881525632 00000100:00100000:1.0:1788526632.414216:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788526632.414232:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881525632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526632.414269:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526632.414305:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881525632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (6615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526632.414312:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788526632.420282:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469e680 x1875405881525632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526632.420321:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881525632:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788526632.420339:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb70e00 x1875405881526144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526632.420350:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788526632.420366:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881526016:0@lo:400:kworker.0 00000100:00100000:0.0:1788526632.420800:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881525888:0@lo:400:kworker.0 00010000:00080000:0.0:1788526632.420829:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c281e44a80 x1875405881526400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526632.420839:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881526400:0@lo:400:kworker.0 00000100:00080000:0.0:1788526632.421143:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526632.421152:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788526633.184283:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526633.427963:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526633.428003:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526633.428107:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526633.428417:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526528 00000100:00100000:3.0:1788526633.428429:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526528 00000100:00100000:3.0:1788526633.428509:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788526633.428520:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526633.428576:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526633.428659:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526633.428667:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788526633.428904:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469c000 x1875405881526528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526633.428934:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526633.634089:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526633.634151:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526633.634190:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526633.634223:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526633.634334:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526633.634658:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905600 00000100:00100000:3.0:1788526633.634684:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905600 00000100:00100000:3.0:1788526633.634788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905728 00000100:00100000:3.0:1788526633.634792:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905728 00000100:00100000:3.0:1788526633.634823:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1788526633.634838:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868905600:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526633.634964:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868905600:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 130us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526633.634973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1788526633.635000:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1788526633.635006:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868905728:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526633.635045:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868905728:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526633.635051:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:1.0:1788526633.635341:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905472 00000100:00100000:1.0:1788526633.635347:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905472 00000100:00100000:1.0:1788526633.635421:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:1.0:1788526633.635430:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868905472:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526633.635483:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868905472:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 54us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526633.635490:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:0.0:1788526633.635699:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905856 00000100:00100000:0.0:1788526633.635707:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905856 00000100:00100000:0.0:1788526633.635750:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868905984 00000100:00100000:0.0:1788526633.635754:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868905984 00000100:00100000:0.0:1788526633.635781:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1788526633.635790:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868905856:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526633.635829:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868905856:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 42us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526633.635837:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1788526633.635852:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1788526633.635859:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868905984:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526633.635885:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868905984:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526633.635891:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00080000:0.0:1788526633.635937:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526633.635942:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526633.635946:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526634.195517:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526635.219720:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526636.246469:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526637.282583:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526637.529686:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881526656:0@lo:400:kworker.0 00000100:00100000:0.0:1788526637.529802:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881526912:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.529814:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526637.529851:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526637.529906:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881527168:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.536222:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526637.536312:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526637.536328:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.536407:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526637.536462:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881526784:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.536496:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526637.536520:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527296:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.536545:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526637.536607:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526656 00000100:00100000:2.0:1788526637.536621:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526656 00000100:00100000:2.0:1788526637.537296:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788526637.537319:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881526656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.537447:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881526656:12345-0@lo:400:kworker.0 Request processed in 135us (7633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526637.537455:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788526637.537511:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526912 00000100:00100000:2.0:1788526637.537517:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526912 00000100:00100000:2.0:1788526637.537564:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527168 00000100:00100000:2.0:1788526637.537567:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527168 00000100:00100000:2.0:1788526637.537588:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881526784 00000100:00100000:2.0:1788526637.537591:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881526784 00000100:00100000:2.0:1788526637.537619:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788526637.537626:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881526912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.537666:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881526912:12345-0@lo:400:kworker.0 Request processed in 40us (7816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526637.537672:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788526637.537686:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788526637.537691:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881527168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526637.539139:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527040 00000100:00100000:3.0:1788526637.539154:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527040 00000100:00100000:3.0:1788526637.539234:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527296 00000100:00100000:3.0:1788526637.539237:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527296 00000100:00100000:3.0:1788526637.539280:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526637.539293:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881527040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526637.539418:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881527040:12345-0@lo:400:kworker.0 Request processed in 128us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526637.539424:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526637.539447:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788526637.539454:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526637.539483:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527296:12345-0@lo:400:kworker.0 Request processed in 31us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526637.539490:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788526637.539513:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788526637.539522:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881526784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526637.539558:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881526784:12345-0@lo:400:kworker.0 Request processed in 37us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526637.539564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788526637.540084:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881527168:12345-0@lo:400:kworker.0 Request processed in 2390us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526637.540093:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788526637.540149:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f5500 x1875405881527040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526637.540167:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881527040:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.540182:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881526656:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.540195:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881527168:0@lo:400:kworker.0 00000100:00080000:2.0:1788526637.540250:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526637.540272:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526637.540275:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526637.540312:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881526784:0@lo:400:kworker.0 00010000:00080000:2.0:1788526637.540326:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f4700 x1875405881527296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526637.540337:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527296:0@lo:400:kworker.0 00000100:00100000:2.0:1788526637.540352:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526637.540364:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526637.540432:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526637.540719:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527424 00000100:00100000:3.0:1788526637.540726:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527424 00000100:00100000:3.0:1788526637.540769:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788526637.540786:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526637.541140:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526637.541210:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 425us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526637.541219:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788526637.541516:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469f800 x1875405881527424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526637.541539:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526637.561192:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881526912:0@lo:400:kworker.0 00010000:00010000:2.0:1788526638.295441:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526638.547870:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881527552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526638.547983:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526638.548151:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527552 00000100:00100000:1.0:1788526638.548162:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527552 00000100:00100000:1.0:1788526638.548240:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788526638.548251:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881527552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526638.548322:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526638.552803:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881527552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4536us (4804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526638.552823:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788526638.554831:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469df80 x1875405881527552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526638.554871:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881527552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526638.753934:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526638.753995:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526638.754039:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526638.754122:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526638.754163:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526638.754197:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906496 00000100:00100000:3.0:1788526638.754207:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906496 00000100:00100000:3.0:1788526638.754278:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906624 00000100:00100000:3.0:1788526638.754290:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906624 00000100:00100000:3.0:1788526638.754315:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1788526638.754338:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526638.754454:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 130us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526638.754462:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1788526638.754480:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1788526638.754487:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526638.754511:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526638.754517:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:0.0:1788526638.757191:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906240 00000100:00100000:0.0:1788526638.757209:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906240 00000100:00100000:0.0:1788526638.757279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906368 00000100:00100000:0.0:1788526638.757283:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906368 00000100:00100000:0.0:1788526638.757323:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1788526638.757344:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868906240:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526638.757499:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868906240:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 156us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526638.757507:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1788526638.757525:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:0.0:1788526638.757532:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906368:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526638.757557:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868906368:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526638.757563:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1788526638.769898:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906112 00000100:00100000:2.0:1788526638.769921:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906112 00000100:00100000:2.0:1788526638.772100:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00100000:2.0:1788526638.772140:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868906112:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526638.772246:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868906112:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 124us (18205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526638.772274:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00080000:2.0:1788526638.778965:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526638.778976:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526638.778979:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788526639.315524:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526640.340727:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526641.366619:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526642.388118:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526642.643667:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881527680:0@lo:400:kworker.0 00000100:00100000:2.0:1788526642.643674:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526642.643861:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788526642.643862:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881527936:0@lo:400:kworker.0 00000100:00100000:2.0:1788526642.644590:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526642.644726:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881528320:0@lo:400:kworker.0 00000100:00100000:2.0:1788526642.644877:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526642.645132:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526642.645726:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527680 00000100:00100000:2.0:1788526642.645735:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527680 00000100:00100000:2.0:1788526642.645974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788526642.646109:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881527680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526642.646242:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881527680:12345-0@lo:400:kworker.0 Request processed in 258us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526642.646249:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788526642.646522:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881528192:0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.646557:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526642.646594:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881527680:0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.646631:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528192 00000100:00100000:3.0:1788526642.646635:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528192 00000100:00100000:3.0:1788526642.646681:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788526642.646688:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881528192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.646725:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881528192:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526642.646731:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788526642.646749:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788526642.646773:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b086680 x1875405881528192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526642.646784:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881528192:0@lo:400:kworker.0 00000100:00100000:0.0:1788526642.647594:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526642.647618:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527808 00000100:00100000:1.0:1788526642.647627:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527808 00000100:00100000:1.0:1788526642.647676:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788526642.647686:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526642.647714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528320 00000100:00100000:3.0:1788526642.647720:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528320 00002000:00000024:1.0:1788526642.647721:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526642.647770:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881527808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (3181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526642.647778:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788526642.647799:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528064 00000100:00100000:3.0:1788526642.647804:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528064 00010000:00080000:1.0:1788526642.647820:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f7100 x1875405881527808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526642.647837:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881527808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526642.647866:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526642.647884:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881528448:0@lo:400:kworker.0 00000100:00100000:1.0:1788526642.647910:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526642.647935:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528448 00000100:00100000:1.0:1788526642.647938:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528448 00000100:00100000:3.0:1788526642.647950:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881527936 00000100:00100000:3.0:1788526642.647957:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881527936 00000100:00100000:1.0:1788526642.647967:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788526642.647980:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.647984:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788526642.647996:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881528320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526642.648027:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881528448:12345-0@lo:400:kworker.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526642.648046:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788526642.648064:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881528320:12345-0@lo:400:kworker.0 Request processed in 69us (3185us total) trans 0 rc 0/0 00010000:00080000:1.0:1788526642.648076:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b084000 x1875405881528448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526642.648086:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788526642.648092:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881528448:0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.648109:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788526642.648118:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881528064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526642.648151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788526642.648160:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881527936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526642.648200:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881527936:12345-0@lo:400:kworker.0 Request processed in 42us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526642.648206:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788526642.648224:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526642.648229:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526642.648247:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881527936:0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.648254:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881528064:12345-0@lo:400:kworker.0 Request processed in 134us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526642.648262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788526642.648285:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881528064:0@lo:400:kworker.0 00000100:00100000:3.0:1788526642.648319:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881528320:0@lo:400:kworker.0 00010000:00010000:0.0:1788526643.417069:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526643.667690:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526643.667713:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526643.667783:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526643.668095:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528576 00000100:00100000:3.0:1788526643.668104:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528576 00000100:00100000:3.0:1788526643.668156:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788526643.668165:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881528576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526643.668213:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526643.668269:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881528576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526643.668276:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788526643.668461:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469c380 x1875405881528576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526643.668491:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526643.866691:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526643.866812:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906880 00000100:00100000:2.0:1788526643.866822:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906880 00000100:00100000:2.0:1788526643.866889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:2.0:1788526643.866900:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868906880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526643.866988:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868906880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 91us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526643.866996:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00080000:1.0:1788526643.868806:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526643.873154:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526643.873188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526643.873221:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526643.873250:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526643.873407:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907136 00000100:00100000:3.0:1788526643.873417:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907136 00000100:00100000:3.0:1788526643.873467:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907264 00000100:00100000:3.0:1788526643.873480:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907264 00000100:00100000:3.0:1788526643.873505:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1788526643.873515:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2347:x1875405868907136:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1788526643.873547:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a2c4 00000100:00080000:3.0:1788526643.873557:0:8450:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526643.873594:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788526643.873970:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+2:2347:x1875405868907136:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 456us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526643.873997:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1788526643.874015:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1788526643.874021:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2347:x1875405868907264:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1788526643.874032:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a2cb 00000100:00080000:3.0:1788526643.874050:0:8450:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526643.874069:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788526643.874259:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+2:2347:x1875405868907264:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 238us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526643.874267:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526643.874557:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907008 00000100:00100000:0.0:1788526643.874563:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907008 00000100:00100000:0.0:1788526643.874596:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:0.0:1788526643.874603:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868907008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526643.874631:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868907008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526643.874650:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1788526643.874777:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868906752 00000100:00100000:2.0:1788526643.874781:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868906752 00000100:00100000:2.0:1788526643.874815:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 247 00000100:00100000:2.0:1788526643.874823:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868906752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526643.874847:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868906752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526643.874853:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 247 00010000:00010000:1.0:1788526643.877841:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526643.877863:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526643.877870:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526643.877873:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788526643.878000:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526644.436738:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526645.459548:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526646.484216:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526646.824820:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000020:00000080:0.0:1788526646.824837:0:7631:0:(genops.c:885:class_export_put()) final put ffff98c26e9e2000/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000020:00000080:2.0:1788526646.825796:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e9e2000/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 for lustre-OST0001 00000020:00000080:2.0:1788526646.825935:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26e9e5800 for lustre-OST0001 00010000:00010000:3.0:1788526647.507564:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526647.765509:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881528704:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.765601:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.765682:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526647.765692:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881528832:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.765721:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.765769:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528704 00000100:00100000:1.0:1788526647.765778:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528704 00000100:00100000:1.0:1788526647.765827:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788526647.765838:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.765893:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881528704:12345-0@lo:400:kworker.0 Request processed in 57us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.765902:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788526647.765939:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528832 00000100:00100000:1.0:1788526647.765943:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528832 00000100:00100000:1.0:1788526647.765970:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788526647.765976:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766011:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881528832:12345-0@lo:400:kworker.0 Request processed in 35us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.766017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788526647.766049:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881528704:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766077:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881528832:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766167:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529088:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766196:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.766216:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526647.766221:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881529216:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766239:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.766330:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529088 00000100:00100000:1.0:1788526647.766334:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529088 00000100:00100000:1.0:1788526647.766372:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788526647.766379:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766457:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529088:12345-0@lo:400:kworker.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.766475:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788526647.766494:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526647.766508:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881529344:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766537:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.766557:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526647.766562:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881528960:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766584:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526647.766607:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529344 00000100:00100000:1.0:1788526647.766611:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529344 00000100:00100000:1.0:1788526647.766640:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788526647.766647:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766685:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881529344:12345-0@lo:400:kworker.0 Request processed in 38us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.766691:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788526647.766710:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788526647.766732:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b087100 x1875405881529344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526647.766743:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881529344:0@lo:400:kworker.0 00010000:00080000:1.0:1788526647.766767:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b086300 x1875405881529088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526647.766774:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529088:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766796:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529216 00000100:00100000:1.0:1788526647.766800:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529216 00000100:00100000:1.0:1788526647.766823:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881528960 00000100:00100000:1.0:1788526647.766826:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881528960 00000100:00100000:1.0:1788526647.766850:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788526647.766855:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881529216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766889:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881529216:12345-0@lo:400:kworker.0 Request processed in 34us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.766895:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788526647.766907:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788526647.766912:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.766941:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881528960:12345-0@lo:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526647.766947:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788526647.766960:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526647.766981:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881528960:0@lo:400:kworker.0 00000100:00100000:1.0:1788526647.767000:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881529216:0@lo:400:kworker.0 00000100:00100000:3.0:1788526647.767294:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881529472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526647.767328:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526647.767704:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529472 00000100:00100000:2.0:1788526647.767711:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529472 00000100:00100000:2.0:1788526647.767793:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788526647.767803:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881529472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526647.767837:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526647.767969:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881529472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526647.767977:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788526647.767992:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469d180 x1875405881529472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526647.768012:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881529472:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788526647.795004:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000020:00000080:1.0:1788526647.795016:0:6693:0:(genops.c:885:class_export_put()) final put ffff98c26e9e5000/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000020:00000080:2.0:1788526647.795083:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e9e5000/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 for lustre-OST0000 00000020:00000080:2.0:1788526647.795144:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26e9e1800 for lustre-OST0000 00010000:00010000:3.0:1788526648.531864:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526648.787613:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526648.787693:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526648.787756:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529600 00000100:00100000:2.0:1788526648.787766:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529600 00000100:00100000:2.0:1788526648.788002:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788526648.788013:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526648.788332:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526648.788774:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 762us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526648.788783:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788526648.788863:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f6300 x1875405881529600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526648.788887:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526648.986556:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526648.986656:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526648.986692:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526648.986795:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907392 00000100:00100000:2.0:1788526648.986806:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907392 00000100:00100000:2.0:1788526648.986871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:2.0:1788526648.986882:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868907392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526648.986942:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907648 00000100:00100000:1.0:1788526648.986955:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907648 00000100:00100000:2.0:1788526648.986960:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868907392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526648.986970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:1.0:1788526648.987002:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907520 00000100:00100000:1.0:1788526648.987006:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907520 00000100:00100000:1.0:1788526648.987047:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1788526648.987056:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868907648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526648.987105:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868907648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526648.987114:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1788526648.987131:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:1.0:1788526648.987139:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868907520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526648.987172:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868907520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526648.987179:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00080000:1.0:1788526648.987200:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788526649.561301:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788526650.439711:0:11007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788526650.580442:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526651.604226:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526652.636286:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526652.886717:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881530112:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.886817:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.886895:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788526652.886901:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526652.886928:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.886957:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881530240:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.886979:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.887545:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881529984:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.887583:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.887605:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881530496:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.887648:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.887672:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788526652.887678:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881529856:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.887710:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.887733:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881530368:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.887755:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526652.887787:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530112 00000100:00100000:1.0:1788526652.887797:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530112 00000100:00100000:1.0:1788526652.887861:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529984 00000100:00100000:1.0:1788526652.887864:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529984 00000100:00100000:1.0:1788526652.887877:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530368 00000100:00100000:1.0:1788526652.887880:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530368 00000100:00100000:1.0:1788526652.887900:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788526652.887910:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881530112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.887972:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881530112:12345-0@lo:400:kworker.0 Request processed in 63us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.887981:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788526652.888002:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788526652.888008:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881529984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.888039:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881529984:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.888046:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788526652.888059:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788526652.888065:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.888092:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881530368:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.888112:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788526652.888133:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529728 00000100:00100000:1.0:1788526652.888138:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529728 00000100:00100000:1.0:1788526652.892605:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788526652.892637:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526652.893524:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526652.893641:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881529728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1016us (6708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.893651:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788526652.893693:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530240 00000100:00100000:1.0:1788526652.893704:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530240 00000100:00100000:1.0:1788526652.893756:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530496 00000100:00100000:1.0:1788526652.893760:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530496 00000100:00100000:1.0:1788526652.893781:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788526652.893788:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.893832:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881530240:12345-0@lo:400:kworker.0 Request processed in 44us (6851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.893838:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788526652.893849:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788526652.893855:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.893886:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881530496:12345-0@lo:400:kworker.0 Request processed in 31us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.893892:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788526652.893924:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881529856 00000100:00100000:1.0:1788526652.893928:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881529856 00000100:00100000:1.0:1788526652.893955:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788526652.893962:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.894009:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881529856:12345-0@lo:400:kworker.0 Request processed in 47us (6297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526652.894016:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1788526652.894059:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526652.894064:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526652.894067:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788526652.894114:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b084000 x1875405881529728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526652.894140:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881529728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788526652.894155:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b086d80 x1875405881530240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526652.894164:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881530240:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.894179:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881530112:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.894230:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881529856:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.894244:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881530368:0@lo:400:kworker.0 00000100:00100000:1.0:1788526652.894259:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881529984:0@lo:400:kworker.0 00010000:00080000:1.0:1788526652.894271:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245221f80 x1875405881530496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526652.894278:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881530496:0@lo:400:kworker.0 00010000:00010000:0.0:1788526653.653583:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526653.911066:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526653.911091:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881530624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526653.911166:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526653.911238:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530624 00000100:00100000:2.0:1788526653.911246:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530624 00000100:00100000:3.0:1788526653.911351:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788526653.911365:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881530624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526653.911512:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526653.911567:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881530624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526653.911575:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788526653.911624:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2742f6680 x1875405881530624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526653.911644:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881530624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526654.106087:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526654.106123:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526654.106146:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526654.106175:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907776 00000100:00100000:3.0:1788526654.106186:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907776 00000100:00100000:3.0:1788526654.106238:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:3.0:1788526654.106249:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868907776:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526654.106335:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868907776:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526654.106343:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:3.0:1788526654.106381:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908032 00000100:00100000:3.0:1788526654.106409:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908032 00000100:00100000:3.0:1788526654.106444:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868907904 00000100:00100000:3.0:1788526654.106448:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868907904 00000100:00100000:3.0:1788526654.106467:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:3.0:1788526654.106474:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868908032:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526654.106505:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868908032:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526654.106512:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:3.0:1788526654.106523:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:3.0:1788526654.106529:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868907904:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526654.106553:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868907904:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526654.106559:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00080000:1.0:1788526654.108677:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788526654.679528:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788526655.667903:0:11155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5120f9c0 20000000:00000080:1.0:1788526655.667922:0:11155:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c274687400 uarg=0000000000000000 20000000:01000000:1.0:1788526655.667962:0:11155:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788526655.667967:0:11155:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788526655.667971:0:11155:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788526655.673998:0:11156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788526655.674164:0:11155:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788526655.691210:0:11155:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788526655.691300:0:11155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691322:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691332:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a277 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691339:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691346:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a293 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691353:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691361:0:11155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691445:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691460:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 13 pid: 5817 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.691491:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881530752:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526655.691595:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.691602:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 20 pid: 5818 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.691610:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881530880:0@lo:104: 00000100:00100000:1.0:1788526655.691649:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526655.692816:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526655.692832:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526655.692845:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531008:0@lo:104: 00000100:00100000:0.0:1788526655.692888:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526655.693680:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.693684:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881530880 00000100:00100000:1.0:1788526655.693695:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881530880 00010000:00010000:0.0:1788526655.693696:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 20 pid: 5817 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.693739:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531008 00000100:00100000:1.0:1788526655.693752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531008 00000100:00100000:1.0:1788526655.693770:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788526655.693780:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11155:x1875405881530880:12345-0@lo:104: 00000100:00100000:0.0:1788526655.693787:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531136:0@lo:104: 00010000:00010000:1.0:1788526655.693796:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526655.693828:0:11155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788526655.693853:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526655.693863:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 13 pid: 5818 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.693864:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788526655.693875:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11155:x1875405881530880:12345-0@lo:104: Request processed in 95us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.693882:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788526655.693898:0:11155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531264:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526655.693948:0:11155:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c258024b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526655.693973:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881530880:0@lo:104: 00010000:00010000:2.0:1788526655.693974:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526655.693984:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.693993:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216de00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526655.693998:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694007:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526655.694024:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526655.694030:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788526655.694071:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694078:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526655.694096:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694104:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c28216de00/0x367645d450b3a293 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a29a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694116:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526655.694118:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526655.694120:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526655.694141:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881531392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526655.694168:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526655.694296:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531392 00000100:00100000:2.0:1788526655.694300:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531392 00010000:00010000:2.0:1788526655.694318:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526655.694340:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526655.694357:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881531392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526655.694367:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526655.694372:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694411:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694437:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045e00/0x367645d450b3a29a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a293 expref: 21 pid: 5818 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.694451:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526655.694483:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3281:x1875405881531392:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526655.694489:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526655.694533:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881531392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526655.694884:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788526655.694895:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531136 00000100:00100000:1.0:1788526655.694899:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531136 00000100:00100000:1.0:1788526655.694914:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788526655.694920:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11155:x1875405881531008:12345-0@lo:104: 00010000:00010000:1.0:1788526655.694939:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.694990:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788526655.694996:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11155:x1875405881531008:12345-0@lo:104: Request processed in 76us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.695002:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788526655.695013:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788526655.695018:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:11155:x1875405881531136:12345-0@lo:104: 00010000:00010000:1.0:1788526655.695025:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695055:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788526655.695060:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:11155:x1875405881531136:12345-0@lo:104: Request processed in 42us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.695065:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788526655.695097:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526655.695102:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695108:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663400 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526655.695112:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695120:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526655.695127:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526655.695139:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526655.695156:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695162:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526655.695178:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695185:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663400/0x367645d450b3a285 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a28c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695196:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526655.695199:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695205:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c200 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526655.695208:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695215:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526655.695221:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526655.695226:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526655.695236:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695254:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526655.695266:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695272:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c28216c200/0x367645d450b3a277 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a27e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695285:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526655.695286:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526655.695289:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526655.695294:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526655.695304:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881531520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526655.695533:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526655.695567:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526655.695573:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881531648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526655.695597:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526655.695627:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531520 00000100:00100000:1.0:1788526655.695632:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531520 00010000:00010000:1.0:1788526655.695649:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.695668:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531648 00000100:00100000:1.0:1788526655.695671:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531648 00010000:00010000:1.0:1788526655.695683:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 21 pid: 5817 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.695694:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788526655.695700:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881531520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788526655.695708:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526655.695712:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 21 pid: 5815 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695730:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 21 pid: 5815 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.695755:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526655.695785:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881531520:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.695791:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788526655.695804:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788526655.695810:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3278:x1875405881531648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788526655.695817:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526655.696200:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54800/0x367645d450b3a28c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a285 expref: 20 pid: 5815 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526655.696211:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531008:0@lo:104: 00000100:00100000:2.0:1788526655.696219:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531136:0@lo:104: 00010000:00010000:1.0:1788526655.696299:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 19 pid: 5817 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.696308:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 19 pid: 5817 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.696319:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044600/0x367645d450b3a27e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a277 expref: 19 pid: 5817 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.696328:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526655.696519:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3278:x1875405881531648:12345-0@lo:103:ldlm_bl.0 Request processed in 709us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.696526:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788526655.696551:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881531648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526655.696559:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881531520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526655.702167:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526655.702222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526655.702263:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908160 00000100:00100000:1.0:1788526655.702273:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908160 00010000:00010000:1.0:1788526655.702314:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 14 pid: 5817 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.702354:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908288 00000100:00100000:1.0:1788526655.702357:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908288 00010000:00010000:1.0:1788526655.702369:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 15 pid: 5818 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526655.702383:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1788526655.702412:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+15:2349:x1875405868908160:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526655.702428:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526655.702434:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 15 pid: 5817 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702446:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 15 pid: 5817 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702466:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526655.702519:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+15:2349:x1875405868908160:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.702526:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1788526655.702544:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1788526655.702551:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868908288:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526655.702559:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526655.702563:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 14 pid: 5818 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702579:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 14 pid: 5818 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702592:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702601:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702616:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702624:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702632:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702639:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702645:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526655.702650:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702659:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702667:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.702688:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526655.702708:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868908288:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 157us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526655.702714:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00010000:00010000:2.0:1788526655.703136:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821c00/0x367645d450b3a2b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59350 expref: 13 pid: 5817 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526655.703152:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881530752:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526655.703166:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044000/0x367645d450b3a270 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59311 expref: 12 pid: 5818 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526655.703176:0:11155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875405881531264:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526655.703209:0:11155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.703237:0:11155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.703256:0:11155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526655.703264:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241662800/0x367645d450b3a2d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526655.704720:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526656.723853:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788526656.857147:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788526656.857160:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c274ba0000 from 7 10000000:01000000:2.0:1788526656.857166:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788526656.857240:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526656.857253:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526656.857266:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526656.857293:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881531776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.857372:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526656.857454:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526656.857764:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531776 00000100:00100000:3.0:1788526656.857786:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531776 00000100:00100000:3.0:1788526656.857835:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788526656.857846:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881531776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526656.857860:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526656.857875:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a2d9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.857898:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.857909:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.857918:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526656.857977:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881531776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.857984:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788526656.858074:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881531776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526656.858101:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526656.858110:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526656.858802:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:1.0:1788526656.861138:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788526656.861463:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788526656.865985:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:1.0:1788526656.866125:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:1.0:1788526656.866169:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:1.0:1788526656.866203:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:1.0:1788526656.866299:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:1.0:1788526656.866307:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:1.0:1788526656.866454:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881531904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.870043:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526656.870267:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551540 going to sleep for 11 seconds 00000100:00100000:3.0:1788526656.870326:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881531904 00000100:00100000:3.0:1788526656.870336:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881531904 00000100:00100000:3.0:1788526656.870462:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788526656.870474:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881531904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.870802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881531904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.870811:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788526656.871358:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881531904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.871435:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.871507:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526656.871531:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551540 going to sleep for 11 seconds 00000100:00100000:3.0:1788526656.871751:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532032 00000100:00100000:3.0:1788526656.871758:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532032 00000100:00100000:3.0:1788526656.871794:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788526656.871802:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.871982:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.871989:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788526656.872067:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788526656.872615:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526656.872682:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532160:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526656.872726:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526656.872755:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c274b836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526656.872934:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532160 00000100:00100000:3.0:1788526656.872939:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532160 00000100:00100000:3.0:1788526656.872971:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788526656.872979:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532160:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.873129:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532160:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 151us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.873135:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788526656.873379:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532160:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788526656.873899:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788526656.873958:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:1.0:1788526656.874014:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:1.0:1788526656.874055:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:1.0:1788526656.874197:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:1.0:1788526656.874245:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532288:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.874627:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526656.874769:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526656.879010:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532288 00000100:00100000:3.0:1788526656.879026:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532288 00000100:00100000:3.0:1788526656.879078:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788526656.879180:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532288:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.879825:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532288:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 738us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.879833:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788526656.880048:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532288:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788526656.880288:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:1.0:1788526656.880646:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:3.0:1788526656.883079:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000020:01000000:1.0:1788526656.883619:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788526656.883631:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526656.883643:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526656.883656:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526656.883672:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788526656.883674:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27453b800 from 7 10000000:01000000:1.0:1788526656.883678:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788526656.883717:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526656.883726:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526656.883757:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526656.883783:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.883855:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526656.883976:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526656.884012:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532416 00000100:00100000:0.0:1788526656.884020:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532416 00000100:00100000:0.0:1788526656.884101:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788526656.884111:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881532416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526656.884127:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526656.884140:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a2e7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.884165:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.884177:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.884186:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:0.0:1788526656.884247:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526656.884261:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788526656.884354:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526656.884371:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526656.884417:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526656.884791:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:2.0:1788526656.886227:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526656.886680:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788526656.886730:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788526656.886784:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788526656.886823:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788526656.886858:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788526656.887186:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788526656.887195:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:2.0:1788526656.887465:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.887535:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526656.890925:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526656.891248:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532544 00000100:00100000:1.0:1788526656.891258:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532544 00000100:00100000:1.0:1788526656.891612:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788526656.891624:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.891945:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526656.891953:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788526656.892119:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.892169:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.892214:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526656.892251:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526656.892504:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532672 00000100:00100000:2.0:1788526656.892510:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532672 00000100:00100000:2.0:1788526656.892654:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788526656.892662:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.892812:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526656.892818:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788526656.892883:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526656.893665:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526656.893734:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532800:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.893786:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526656.893818:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532800 00000100:00100000:2.0:1788526656.893822:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532800 00000100:00100000:2.0:1788526656.893845:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788526656.893851:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532800:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.894213:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532800:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 361us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526656.894232:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788526656.894275:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526656.894290:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532800:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788526656.894859:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788526656.894982:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788526656.895047:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788526656.895276:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788526656.895556:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:2.0:1788526656.895598:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532928:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.895663:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526656.895755:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526656.895794:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881532928 00000100:00100000:1.0:1788526656.895802:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881532928 00000100:00100000:1.0:1788526656.895946:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788526656.895956:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532928:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526656.896268:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881532928:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 314us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526656.896276:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788526656.896505:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881532928:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526656.896635:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788526656.896648:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788526656.899253:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:3.0:1788526656.899664:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788526656.899679:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788526656.899691:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.899724:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526656.899737:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788526656.899739:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c248515800 from 7 10000000:01000000:3.0:1788526656.899742:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526656.899780:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.899788:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.899799:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526656.899823:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.899964:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526656.900054:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1788526656.900160:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533056 00000100:00100000:0.0:1788526656.900168:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533056 00000100:00100000:0.0:1788526656.900266:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788526656.900277:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881533056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526656.900292:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526656.900324:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a2f5 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.900353:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.900364:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.900373:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821400, rc 0) 00000100:00100000:0.0:1788526656.900469:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881533056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526656.900476:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788526656.900687:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526656.900704:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.900713:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526656.900751:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.900778:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526656.901038:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ff300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526656.901157:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533184 00000100:00100000:2.0:1788526656.901163:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533184 00000100:00100000:2.0:1788526656.901190:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788526656.901197:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881533184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.901508:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881533184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526656.901516:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788526656.901693:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.901725:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.901762:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526656.901788:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ff300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526656.901825:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533312 00000100:00100000:2.0:1788526656.901830:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533312 00000100:00100000:2.0:1788526656.901850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788526656.901857:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881533312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.902008:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881533312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526656.902016:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788526656.902200:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881533312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788526656.903133:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788526656.903538:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788526656.903548:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788526656.903559:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526656.903570:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526656.919670:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526656.919779:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908416 00000100:00100000:0.0:1788526656.919790:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908416 00000100:00100000:0.0:1788526656.919847:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 265 00000100:00100000:0.0:1788526656.919858:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+12:5591:x1875405868908416:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526656.919882:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526656.919903:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5937a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.919935:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.919961:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526656.919971:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821c00, rc 0) 00000100:00100000:0.0:1788526656.920035:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908416:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 178us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526656.920042:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 265 00000100:00100000:1.0:1788526656.928590:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526656.928845:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908544 00000100:00100000:3.0:1788526656.928857:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908544 00000100:00100000:3.0:1788526656.929685:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 266 00000100:00100000:3.0:1788526656.929711:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908544:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.930007:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908544:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 310us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.930015:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 266 00000100:00100000:1.0:1788526656.944436:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526656.946432:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908672 00000100:00100000:3.0:1788526656.946450:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908672 00000100:00100000:3.0:1788526656.946527:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 267 00000100:00100000:3.0:1788526656.946538:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908672:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.947164:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908672:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 625us (2737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.947173:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 267 00000100:00100000:2.0:1788526656.956340:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526656.956491:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908800 00000100:00100000:3.0:1788526656.956514:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908800 00000100:00100000:3.0:1788526656.956568:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 268 00000100:00100000:3.0:1788526656.956621:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868908800:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526656.956648:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526656.956667:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59381 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.956701:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.956714:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526656.956723:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54e00, rc 0) 00000100:00100000:3.0:1788526656.956790:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868908800:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 212us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.956797:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 268 00000100:00100000:2.0:1788526656.966646:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526656.966935:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868908928 00000100:00100000:3.0:1788526656.966946:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868908928 00000100:00100000:3.0:1788526656.967035:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 269 00000100:00100000:3.0:1788526656.967047:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868908928:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526656.967790:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868908928:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 742us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526656.967799:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 269 00000100:00100000:2.0:1788526656.995751:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526656.995812:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909056 00000100:00100000:2.0:1788526656.995822:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909056 00000100:00100000:2.0:1788526656.995886:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 270 00000100:00100000:2.0:1788526656.995898:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868909056:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526656.996636:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868909056:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 738us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526656.996652:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 270 00010000:00010000:1.0:1788526657.748744:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526658.007368:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881533440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526658.007454:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526658.011207:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881533696:0@lo:400:kworker.0 00000100:00100000:2.0:1788526658.011305:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526658.011376:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881534208:0@lo:400:kworker.0 00000100:00100000:2.0:1788526658.011423:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526658.011458:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526658.011465:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881533824:0@lo:400:kworker.0 00000100:00100000:2.0:1788526658.011523:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526658.011562:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881533568:0@lo:400:kworker.0 00000100:00100000:2.0:1788526658.011594:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526658.011617:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881534080:0@lo:400:kworker.0 00000100:00100000:2.0:1788526658.011637:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526658.023454:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533696 00000100:00100000:3.0:1788526658.023472:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533696 00000100:00100000:3.0:1788526658.023560:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533824 00000100:00100000:3.0:1788526658.023565:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533824 00000100:00100000:3.0:1788526658.023592:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534080 00000100:00100000:3.0:1788526658.023595:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534080 00000100:00100000:3.0:1788526658.023614:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788526658.023640:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.023730:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881533696:12345-0@lo:400:kworker.0 Request processed in 92us (12424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526658.023737:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788526658.023757:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788526658.023763:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881533824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.023788:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881533824:12345-0@lo:400:kworker.0 Request processed in 26us (12280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526658.023794:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788526658.023804:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788526658.023810:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881534080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.023842:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881534080:12345-0@lo:400:kworker.0 Request processed in 32us (12203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526658.023848:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788526658.023875:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533568 00000100:00100000:3.0:1788526658.023880:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533568 00000100:00100000:3.0:1788526658.023904:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788526658.023910:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.023939:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881533568:12345-0@lo:400:kworker.0 Request processed in 30us (12345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526658.023946:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1788526658.023975:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526658.024007:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881533824:0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.024021:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881533696:0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.024054:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881533568:0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.025726:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881534080:0@lo:400:kworker.0 00000100:00100000:1.0:1788526658.026111:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534208 00000100:00100000:1.0:1788526658.026119:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534208 00000100:00100000:1.0:1788526658.026180:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788526658.026190:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881534208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526658.026268:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881534208:12345-0@lo:400:kworker.0 Request processed in 80us (14844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526658.026275:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788526658.026368:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788526658.026415:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245222680 x1875405881534208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526658.026427:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881534208:0@lo:400:kworker.0 00000100:00100000:1.0:1788526658.026454:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881533952:0@lo:400:kworker.0 00000100:00100000:1.0:1788526658.026490:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526658.026530:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533952 00000100:00100000:1.0:1788526658.026534:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533952 00000100:00100000:1.0:1788526658.026564:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788526658.026571:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881533952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526658.026603:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881533952:12345-0@lo:400:kworker.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526658.026609:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788526658.026623:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788526658.026639:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c245220e00 x1875405881533952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526658.026648:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881533952:0@lo:400:kworker.0 00000100:00100000:3.0:1788526658.031617:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881533440 00000100:00100000:3.0:1788526658.031633:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881533440 00000100:00100000:3.0:1788526658.031707:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788526658.031717:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881533440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526658.031757:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526658.031842:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881533440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (24386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526658.031849:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788526658.034297:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27b084000 x1875405881533440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526658.034349:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881533440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788526658.771549:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526659.035432:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c141d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881534336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526659.035507:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526659.035845:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534336 00000100:00100000:2.0:1788526659.035853:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534336 00000100:00100000:2.0:1788526659.035913:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788526659.035923:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881534336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526659.035959:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526659.036007:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881534336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526659.036015:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788526659.036151:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c141d61c00 x1875405881534336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526659.036172:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c141d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881534336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526659.230168:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526659.230220:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526659.230263:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526659.230277:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909184 00000100:00100000:2.0:1788526659.230290:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909440 00000100:00100000:1.0:1788526659.230290:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909184 00000100:00100000:2.0:1788526659.230297:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909440 00000100:00100000:1.0:1788526659.230352:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 272 00000100:00100000:2.0:1788526659.230356:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909312 00000100:00100000:2.0:1788526659.230360:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909312 00000100:00100000:1.0:1788526659.230365:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868909184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526659.230402:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:2.0:1788526659.230413:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868909440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526659.230479:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868909440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526659.230487:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:2.0:1788526659.230502:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00100000:2.0:1788526659.230508:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868909312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526659.230547:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868909184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 184us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526659.230555:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 272 00000100:00100000:2.0:1788526659.230611:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868909312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526659.230618:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00080000:2.0:1788526659.230640:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788526659.797116:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788526660.737561:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788526660.819605:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526661.844409:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526662.867683:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526663.123732:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526663.123780:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881534464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526663.123886:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526663.124263:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534464 00000100:00100000:1.0:1788526663.124275:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534464 00000100:00100000:1.0:1788526663.124356:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788526663.124367:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881534464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526663.124445:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526663.124513:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881534464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526663.124521:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788526663.124600:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788526663.124718:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb75180 x1875405881534464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526663.124749:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881534464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526663.125065:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526663.125077:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.125136:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526663.125182:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534592 00000100:00100000:2.0:1788526663.125187:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534592 00000100:00100000:2.0:1788526663.125222:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788526663.125228:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881534592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.125263:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881534592:12345-0@lo:400:kworker.0 Request processed in 35us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526663.125269:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788526663.125304:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.125933:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881534848:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.125970:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526663.126074:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534848 00000100:00100000:3.0:1788526663.126080:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534848 00000100:00100000:3.0:1788526663.126141:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788526663.126149:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881534848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526663.126190:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881534848:12345-0@lo:400:kworker.0 Request processed in 43us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526663.126196:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788526663.126258:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881534848:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.126272:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526663.126277:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881534720:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.126298:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526663.126328:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534720 00000100:00100000:2.0:1788526663.126331:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534720 00000100:00100000:2.0:1788526663.126352:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788526663.126357:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881534720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.126411:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881534720:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526663.126417:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:2.0:1788526663.126435:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526663.126445:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881534976:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.126471:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526663.127602:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526663.127628:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881535104:0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.127696:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526663.128172:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535104 00000100:00100000:3.0:1788526663.128181:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535104 00000100:00100000:3.0:1788526663.128246:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788526663.128254:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881535104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526663.128314:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881535104:12345-0@lo:400:kworker.0 Request processed in 60us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526663.128321:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788526663.129085:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881534976 00000100:00100000:2.0:1788526663.129094:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881534976 00000100:00100000:2.0:1788526663.129167:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788526663.129177:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881534976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526663.129237:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881534976:12345-0@lo:400:kworker.0 Request processed in 63us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526663.129243:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788526663.129336:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881535104:0@lo:400:kworker.0 00010000:00080000:2.0:1788526663.129355:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27469c380 x1875405881534976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526663.129367:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881534976:0@lo:400:kworker.0 00000100:00080000:3.0:1788526663.130216:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526663.130239:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526663.130284:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881534720:0@lo:400:kworker.0 00010000:00010000:2.0:1788526663.894684:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526664.147648:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881535232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526664.147765:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526664.147877:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535232 00000100:00100000:0.0:1788526664.147887:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535232 00000100:00100000:0.0:1788526664.147961:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788526664.147973:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881535232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526664.148031:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526664.154840:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881535232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6852us (7059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526664.154861:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788526664.155161:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26eb74a80 x1875405881535232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526664.155198:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881535232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526664.354634:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526664.354698:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526664.354725:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526664.354764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909824 00000100:00100000:0.0:1788526664.354786:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909824 00000100:00100000:0.0:1788526664.354863:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909696 00000100:00100000:0.0:1788526664.354866:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909696 00000100:00100000:0.0:1788526664.354891:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1788526664.354902:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868909824:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526664.354996:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868909824:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526664.355004:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1788526664.355023:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:0.0:1788526664.355030:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868909696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526664.355056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868909696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526664.355063:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00080000:0.0:1788526664.355093:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526664.355157:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909568 00000100:00100000:2.0:1788526664.355162:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909568 00000100:00100000:2.0:1788526664.355203:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 274 00000100:00100000:2.0:1788526664.355211:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868909568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526664.355240:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868909568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526664.355247:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 274 00000001:02000400:3.0:1788526664.516624:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:57:42 (1788526662) === 00000100:00100000:2.0:1788526664.705368:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.705885:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.705941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910080 00000100:00100000:2.0:1788526664.705954:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910080 00000100:00100000:2.0:1788526664.706027:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1788526664.706041:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f122900d-e71c-4fc3-b559-b19040da7c34+6:9676:x1875405868910080:12345-192.168.204.59@tcp:700:mkdir.0 00000100:00100000:2.0:1788526664.706172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f122900d-e71c-4fc3-b559-b19040da7c34+6:9676:x1875405868910080:12345-192.168.204.59@tcp:700:mkdir.0 Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526664.706182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526664.718810:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868909952 00000100:00100000:3.0:1788526664.718911:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868909952 00000100:00100000:3.0:1788526664.720037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1788526664.720061:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868909952:12345-192.168.204.59@tcp:41:mkdir.0 00000004:00000024:3.0:1788526664.720140:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788526664.728425:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868909952:12345-192.168.204.59@tcp:41:mkdir.0 Request processed in 8354us (23052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526664.728448:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1788526664.738755:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526664.739175:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910336 00000100:00100000:3.0:1788526664.739257:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910336 00000100:00100000:3.0:1788526664.739349:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1788526664.739363:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:9676:x1875405868910336:12345-192.168.204.59@tcp:36:mkdir.0 00010000:00010000:3.0:1788526664.739474:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526664.739519:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a1cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592fc expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.739545:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972600) 00010000:00010000:3.0:1788526664.739574:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526664.740016:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.740034:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.740045:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.748375:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.748437:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.748479:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526664.753307:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788526664.753338:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753350:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753360:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753366:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526664.753372:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753383:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753428:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526664.753432:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526664.753439:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.753445:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a311 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526664.753476:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000302cb1fe reply state 0000000018e051ba transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526664.753497:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526664.753655:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:9676:x1875405868910336:12345-192.168.204.59@tcp:36:mkdir.0 Request processed in 14289us (14908us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788526664.753666:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:2.0:1788526664.765170:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765197:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765207:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765214:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282045a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526664.765222:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765232:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765255:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c242a8bc00) 00010000:00010000:2.0:1788526664.765258:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526664.765281:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.765289:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a318 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526664.768308:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.768446:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910464 00000100:00100000:2.0:1788526664.768460:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910464 00000100:00100000:2.0:1788526664.768547:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526664.768560:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:9677:x1875405868910464:12345-192.168.204.59@tcp:101:chmod.0 00010000:00010000:2.0:1788526664.768604:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526664.768634:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a31f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59388 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768746:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768764:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768779:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526664.768830:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788526664.768846:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526664.768899:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768939:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a31f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59388 expref: 8 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768964:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59388 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.768974:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:2.0:1788526664.768978:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526664.768983:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044e00, rc 0) 00000100:00100000:2.0:1788526664.769064:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:9677:x1875405868910464:12345-192.168.204.59@tcp:101:chmod.0 Request processed in 506us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526664.769087:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526664.772014:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526664.772100:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910720 00000100:00100000:0.0:1788526664.772113:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910720 00000100:00100000:0.0:1788526664.772193:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1788526664.772208:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:9677:x1875405868910720:12345-192.168.204.59@tcp:36:chmod.0 00010000:00010000:0.0:1788526664.772284:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526664.772326:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a326 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59388 expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.772350:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:0.0:1788526664.772364:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526664.772430:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.772450:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.772461:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526664.772887:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4f50d8c reply state 0000000060fa66b1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526664.772898:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788526664.772908:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788526664.773030:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:9677:x1875405868910720:12345-192.168.204.59@tcp:36:chmod.0 Request processed in 825us (1031us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788526664.773039:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00010000:00010000:3.0:1788526664.777407:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777427:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777437:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777444:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526664.777450:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777459:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777483:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972800) 00010000:00010000:3.0:1788526664.777486:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788526664.777492:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.777499:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a32d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526664.836790:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.836980:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910848 00000100:00100000:2.0:1788526664.836994:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910848 00000100:00100000:2.0:1788526664.837077:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1788526664.837091:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:9678:x1875405868910848:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:2.0:1788526664.837126:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526664.837158:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5938f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837254:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837289:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837305:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526664.837360:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788526664.837365:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526664.837474:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837510:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5938f expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837535:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5938f expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.837554:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526664.837557:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526664.837562:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282045a00, rc 0) 00000100:00100000:2.0:1788526664.837642:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+8:9678:x1875405868910848:12345-192.168.204.59@tcp:101:chown.0 Request processed in 554us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526664.837650:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1788526664.848891:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526664.848968:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868910976 00000100:00100000:1.0:1788526664.848984:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868910976 00000100:00100000:1.0:1788526664.849137:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1788526664.849160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:9678:x1875405868910976:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:1.0:1788526664.849193:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526664.849227:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59396 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849319:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849341:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849357:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849375:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849382:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849409:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849529:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849538:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849557:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526664.849598:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788526664.849602:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526664.849626:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849640:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849648:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849655:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849662:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526664.849669:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849678:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849693:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60200) 00010000:00010000:1.0:1788526664.849697:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526664.849703:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849709:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663400/0x367645d450b3a349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849732:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849738:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849744:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849749:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526664.849752:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849758:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.849764:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c272284e00) 00010000:00010000:1.0:1788526664.849766:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526664.849769:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.853646:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a350 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.853765:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a342 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59396 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.854979:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59396 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.856163:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c272284a00) 00010000:00010000:1.0:1788526664.856168:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526664.856174:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241662800, rc 0) 00000100:00100000:1.0:1788526664.856295:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:9678:x1875405868910976:12345-192.168.204.59@tcp:101:chown.0 Request processed in 7133us (7414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526664.856308:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1788526664.861075:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526664.861250:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868911232 00000100:00100000:0.0:1788526664.861267:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868911232 00000100:00100000:0.0:1788526664.861530:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1788526664.861546:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+9:9678:x1875405868911232:12345-192.168.204.59@tcp:36:chown.0 00010000:00010000:0.0:1788526664.861629:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526664.861666:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59396 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.861689:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c272284a00) 00010000:00010000:0.0:1788526664.861705:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526664.861744:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.861761:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.861793:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526664.916862:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788526664.917584:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788526664.920091:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9d1022 reply state 000000008085dc74 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526664.920117:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788526664.920138:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788526664.920296:0:5823:0:(ldlm_lib.c:3496:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788526664.920582:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:9678:x1875405868911232:12345-192.168.204.59@tcp:36:chown.0 Request processed in 59032us (59522us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788526664.920595:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00010000:00010000:1.0:1788526664.922602:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922623:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922631:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922638:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526664.922645:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922654:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922676:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972900) 00010000:00010000:1.0:1788526664.922679:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526664.922685:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526664.922692:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a35e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526664.943137:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526664.943492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868911360 00000100:00100000:3.0:1788526664.943506:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868911360 00000100:00100000:3.0:1788526664.943575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1788526664.943586:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:9679:x1875405868911360:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:3.0:1788526664.943618:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526664.943643:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5939d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526664.948873:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5154us 00010000:00010000:0.0:1788526664.967667:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.967698:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.967714:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.967733:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.967740:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.967747:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968191:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968209:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968217:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526664.968249:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526664.968253:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526664.968301:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968318:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968325:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968333:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968340:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526664.968345:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968354:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968370:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60200) 00010000:00010000:0.0:1788526664.968373:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526664.968379:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968421:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a36c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968434:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968441:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968446:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968452:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526664.968455:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968461:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968468:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c243972400) 00010000:00010000:0.0:1788526664.968477:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526664.968481:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968486:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a373 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968540:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5939d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968558:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5939d expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.968572:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:0.0:1788526664.968574:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788526664.968577:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821a00, rc 0) 00000100:00100000:0.0:1788526664.968688:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:9679:x1875405868911360:12345-192.168.204.59@tcp:101:touch.500 Request processed in 25100us (25574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526664.968697:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1788526664.975582:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.975680:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868911616 00000100:00100000:2.0:1788526664.975693:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868911616 00000100:00100000:2.0:1788526664.975793:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1788526664.975806:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:9679:x1875405868911616:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:2.0:1788526664.975835:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526664.975865:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a381 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593a4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976240:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976259:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976273:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976290:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976311:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.976318:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526664.980093:0:6721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788526664.980652:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044600/0x367645d450b3a396 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980674:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044600/0x367645d450b3a396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980689:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044600/0x367645d450b3a396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980734:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980741:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980749:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980755:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282045e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526664.980760:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980768:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980810:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526664.980813:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526664.980819:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980827:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045e00/0x367645d450b3a388 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526664.980841:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f60c4ea6 reply state 000000002e6cf910 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526664.980852:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788526664.980899:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045c00/0x367645d450b3a381 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593a4 expref: 10 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980914:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044600/0x367645d450b3a396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593a4 expref: 9 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.980922:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c260d60700) 00010000:00010000:2.0:1788526664.980925:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526664.980927:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c282044600, rc 0) 00000100:00100000:2.0:1788526664.981033:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+10:9679:x1875405868911616:12345-192.168.204.59@tcp:101:touch.500 Request processed in 5229us (5470us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788526664.981043:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:0.0:1788526664.985803:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985831:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985841:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985849:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526664.985856:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985865:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985892:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff98c260d60d00) 00010000:00010000:0.0:1788526664.985896:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526664.985904:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526664.985911:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044e00/0x367645d450b3a38f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526664.988600:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526664.990541:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868911872 00000100:00100000:2.0:1788526664.990562:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868911872 00000100:00100000:2.0:1788526664.990651:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1788526664.990663:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:9679:x1875405868911872:12345-192.168.204.59@tcp:36:touch.500 00010000:00010000:2.0:1788526664.990767:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526664.990804:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282044600/0x367645d450b3a396 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593a4 expref: 9 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.990831:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c260d60700) 00010000:00010000:2.0:1788526664.990845:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526664.990903:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.990919:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526664.990930:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526664.991128:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cdcf01b reply state 00000000b9f361ad transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526664.991140:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526664.991274:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+10:9679:x1875405868911872:12345-192.168.204.59@tcp:36:touch.500 Request processed in 611us (2884us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788526664.991282:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1788526665.003928:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:2.0:1788526665.005513:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005534:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005544:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005575:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526665.005583:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005592:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005614:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c260d60600) 00010000:00010000:2.0:1788526665.005617:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526665.005623:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.005630:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526665.008217:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912000 00000100:00100000:3.0:1788526665.008240:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912000 00000100:00100000:3.0:1788526665.010189:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1788526665.010223:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+9:9679:x1875405868912000:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:3.0:1788526665.010261:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526665.010297:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a3ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526665.010418:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a3ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ab expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526665.010437:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a3ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ab expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526665.010463:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c242a8b900) 00010000:00010000:3.0:1788526665.010467:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526665.010492:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:3.0:1788526665.010591:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+10:9679:x1875405868912000:12345-192.168.204.59@tcp:101:touch.500 Request processed in 386us (6681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526665.010599:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1788526665.017002:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.017131:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912128 00000100:00100000:2.0:1788526665.017147:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912128 00000100:00100000:2.0:1788526665.017210:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526665.017225:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875405868912128:12345-192.168.204.59@tcp:8:touch.500 00010000:00080000:2.0:1788526665.017270:0:6671:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1788526665.017323:0:6671:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a3b2 00002000:00100000:2.0:1788526665.017342:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f122900d-e71c-4fc3-b559-b19040da7c34/ffff98c248207800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788526665.017376:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788526665.018169:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788526665.018215:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c248200800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526665.018467:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868912128:12345-192.168.204.59@tcp:8:touch.500 Request processed in 1245us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526665.018488:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526665.028999:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.029107:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912256 00000100:00100000:2.0:1788526665.029121:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912256 00000100:00100000:2.0:1788526665.029226:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1788526665.029238:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:0:x1875405868912256:12345-192.168.204.59@tcp:2:touch.500 00000100:00080000:0.0:1788526665.029997:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788526665.140942:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788526665.140970:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000100:00100000:2.0:1788526665.141312:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:0:x1875405868912256:12345-192.168.204.59@tcp:2:touch.500 Request processed in 112065us (112315us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788526665.141328:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1788526665.144051:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.144605:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912512 00000100:00100000:2.0:1788526665.144620:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912512 00000100:00100000:2.0:1788526665.144698:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1788526665.144720:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+10:9679:x1875405868912512:12345-192.168.204.59@tcp:35:touch.500 00000100:00100000:3.0:1788526665.149791:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+11:9679:x1875405868912512:12345-192.168.204.59@tcp:35:touch.500 Request processed in 4849us (5530us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788526665.149824:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1788526665.159914:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.160104:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912640 00000100:00100000:2.0:1788526665.160119:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912640 00000100:00100000:2.0:1788526665.160214:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:2.0:1788526665.160227:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+11:9680:x1875405868912640:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:2.0:1788526665.160266:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526665.160295:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593b2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160439:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160460:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160475:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526665.160546:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788526665.160552:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526665.160610:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160651:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593b2 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160679:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593b2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.160690:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526665.160694:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526665.160699:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216de00, rc 0) 00000100:00100000:2.0:1788526665.160805:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+12:9680:x1875405868912640:12345-192.168.204.59@tcp:101:rm.0 Request processed in 581us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526665.160813:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1788526665.167014:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.167370:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868912896 00000100:00100000:2.0:1788526665.167384:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868912896 00000100:00100000:2.0:1788526665.167478:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1788526665.167489:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+12:9680:x1875405868912896:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:2.0:1788526665.167517:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526665.167542:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593b9 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526665.167668:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788526665.167924:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593b9 expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.167951:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526665.167955:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526665.167961:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593b9 expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.167977:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216c200, rc 0) 00000100:00100000:2.0:1788526665.168077:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:9680:x1875405868912896:12345-192.168.204.59@tcp:101:rm.0 Request processed in 589us (1078us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788526665.168085:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1788526665.173013:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526665.173127:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868913024 00000100:00100000:1.0:1788526665.173142:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868913024 00000100:00100000:1.0:1788526665.173229:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1788526665.173243:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:9680:x1875405868913024:12345-192.168.204.59@tcp:37:rm.0 00000100:00100000:0.0:1788526665.179089:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:9680:x1875405868913024:12345-192.168.204.59@tcp:37:rm.0 Request processed in 5831us (6073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526665.179106:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1788526665.183229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526665.183330:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868913280 00000100:00100000:3.0:1788526665.183345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868913280 00000100:00100000:3.0:1788526665.183443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1788526665.183457:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:9680:x1875405868913280:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:3.0:1788526665.183819:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+14:9680:x1875405868913280:12345-192.168.204.59@tcp:35:rm.0 Request processed in 364us (604us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788526665.183828:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1788526665.186572:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.186688:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868913536 00000100:00100000:2.0:1788526665.186700:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868913536 00000100:00100000:2.0:1788526665.186780:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1788526665.186790:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+14:9680:x1875405868913536:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:2.0:1788526665.186824:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526665.186850:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593c0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.186978:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a3dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.186995:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a3dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.187008:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a3dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526665.187019:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788526665.187285:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c0 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.187311:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a3dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c0 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.187324:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526665.187328:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788526665.187332:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c28216cc00, rc 0) 00000100:00100000:2.0:1788526665.187501:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868913536:12345-192.168.204.59@tcp:101:rm.0 Request processed in 710us (943us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788526665.187508:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:1.0:1788526665.191267:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.191694:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868913664 00000100:00100000:2.0:1788526665.191717:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868913664 00000100:00100000:2.0:1788526665.191788:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:2.0:1788526665.191801:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868913664:12345-192.168.204.59@tcp:41:rm.0 00000004:00000024:2.0:1788526665.191886:0:6721:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788526665.192025:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868913664:12345-192.168.204.59@tcp:41:rm.0 Request processed in 226us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526665.192042:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1788526665.194803:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526665.194932:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868913792 00000100:00100000:2.0:1788526665.194946:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868913792 00000100:00100000:2.0:1788526665.195115:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1788526665.195128:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868913792:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:2.0:1788526665.195159:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526665.195258:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593c7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195432:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195452:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195467:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195486:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195494:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195500:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195642:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195652:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195660:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526665.195697:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788526665.195715:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526665.195741:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195769:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195779:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195787:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195794:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195801:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526665.195806:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195814:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195829:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526665.195833:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526665.195839:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195846:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a3f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195862:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195868:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195881:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195886:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526665.195889:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195895:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195903:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff98c260d60600) 00010000:00010000:2.0:1788526665.195905:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526665.195909:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195915:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3a3f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195954:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216c200/0x367645d450b3a3ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c7 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195971:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c7 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.195978:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c242a8b900) 00010000:00010000:2.0:1788526665.195980:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526665.195983:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76800, rc 0) 00000100:00100000:2.0:1788526665.196673:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+17:9680:x1875405868913792:12345-192.168.204.59@tcp:101:rm.0 Request processed in 1544us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526665.196696:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1788526665.200145:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526665.200337:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914048 00000100:00100000:1.0:1788526665.200353:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914048 00000100:00100000:1.0:1788526665.200455:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1788526665.200468:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+17:9680:x1875405868914048:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:1.0:1788526665.200544:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788526665.200580:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3a3ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c7 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200607:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a3ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ab expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200620:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c242a8b900) 00010000:00010000:1.0:1788526665.200638:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216de00/0x367645d450b3a3c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593b2 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200649:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526665.200671:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526665.200718:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200736:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200747:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200765:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200772:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200779:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200929:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200938:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.200945:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526665.201872:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788526665.201886:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300542498669ns, next at 301542495780ns, rc = 0 00010000:00010000:1.0:1788526665.201970:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.201998:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202009:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202020:0:6721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202028:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202035:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202080:0:6721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526665.202118:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526665.202125:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202134:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526665.202140:0:7617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202149:0:7617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202162:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c272284500) 00010000:00010000:1.0:1788526665.202165:0:7617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788526665.202171:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202188:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a41b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202205:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526665.202207:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526665.202209:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526665.202232:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202238:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202244:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202249:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526665.202254:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202259:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202268:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98c272284500) 00010000:00010000:1.0:1788526665.202271:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788526665.202274:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202280:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a414 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202304:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202317:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202324:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202330:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526665.202334:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202341:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202350:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526665.202353:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526665.202357:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.202363:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788526665.202376:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000962c3481 reply state 000000006a30fb7a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526665.202424:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526665.203637:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868914048:12345-192.168.204.59@tcp:36:rm.0 Request processed in 3159us (3495us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788526665.203650:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00010000:00010000:0.0:1788526665.207639:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207663:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207673:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207680:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526665.207686:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207696:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207792:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x68574761 (ffff98c272284e00) 00010000:00010000:0.0:1788526665.207797:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526665.207822:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.207830:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663000/0x367645d450b3a40d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x68574761 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526665.208824:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526665.209139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914304 00000100:00100000:3.0:1788526665.209153:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914304 00000100:00100000:3.0:1788526665.209237:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1788526665.209251:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+15:9680:x1875405868914304:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:3.0:1788526665.209605:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868914304:12345-192.168.204.59@tcp:35:rm.0 Request processed in 357us (789us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788526665.209614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1788526665.212518:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526665.212634:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914560 00000100:00100000:0.0:1788526665.212648:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914560 00000100:00100000:0.0:1788526665.212730:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:0.0:1788526665.212741:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:9680:x1875405868914560:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:0.0:1788526665.212820:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788526665.212855:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c28216cc00/0x367645d450b3a3dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593c0 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.212885:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a37a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5939d expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.212899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972c00) 00010000:00010000:0.0:1788526665.212916:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c282045a00/0x367645d450b3a33b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5938f expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.212925:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60200) 00010000:00010000:0.0:1788526665.212933:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526665.212964:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.212979:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213013:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213029:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213036:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213042:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213983:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.213997:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.214005:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526665.215304:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788526665.215331:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215341:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215350:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215356:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526665.215369:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215379:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215584:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98c243972000) 00010000:00010000:0.0:1788526665.215588:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788526665.215593:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215601:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a430 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215633:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215639:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215646:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215651:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526665.215654:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215660:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215666:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972400) 00010000:00010000:0.0:1788526665.215668:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526665.215676:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526665.215682:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a422 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526665.215695:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000965e9b87 reply state 0000000009c0d0cc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526665.215770:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526665.215962:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:9680:x1875405868914560:12345-192.168.204.59@tcp:36:rm.0 Request processed in 3217us (3455us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788526665.215972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00010000:00010000:2.0:1788526665.224666:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224692:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224712:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224721:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526665.224728:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224738:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224761:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98c243972e00) 00010000:00010000:2.0:1788526665.224765:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526665.224771:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526665.224778:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820a00/0x367645d450b3a429 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526665.941126:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526666.968101:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526667.991655:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526668.247314:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881535744:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247431:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247502:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788526668.247509:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881535360:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247541:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247563:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881535872:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247587:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247634:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881535488:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247658:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247675:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881536000:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247694:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247710:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788526668.247715:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881535616:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247735:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526668.247784:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535744 00000100:00100000:0.0:1788526668.247793:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535744 00000100:00100000:0.0:1788526668.247854:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536000 00000100:00100000:0.0:1788526668.247857:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536000 00000100:00100000:0.0:1788526668.247882:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788526668.247892:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.247949:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881535744:12345-0@lo:400:kworker.0 Request processed in 59us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.247957:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788526668.247973:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788526668.247978:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248019:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881536000:12345-0@lo:400:kworker.0 Request processed in 41us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.248025:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788526668.248043:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535360 00000100:00100000:0.0:1788526668.248046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535360 00000100:00100000:0.0:1788526668.248070:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788526668.248076:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881535360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248106:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881535360:12345-0@lo:400:kworker.0 Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.248112:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788526668.248140:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535872 00000100:00100000:0.0:1788526668.248143:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535872 00000100:00100000:0.0:1788526668.248183:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535488 00000100:00100000:0.0:1788526668.248186:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535488 00000100:00100000:0.0:1788526668.248198:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881535616 00000100:00100000:0.0:1788526668.248200:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881535616 00000100:00100000:0.0:1788526668.248213:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788526668.248219:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881535872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248254:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881535872:12345-0@lo:400:kworker.0 Request processed in 35us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.248261:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788526668.248273:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788526668.248278:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881535488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248303:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881535488:12345-0@lo:400:kworker.0 Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.248309:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788526668.248319:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788526668.248325:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248350:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881535616:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526668.248356:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788526668.248378:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788526668.248383:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526668.248411:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526668.248468:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881535616:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248481:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881535488:0@lo:400:kworker.0 00010000:00080000:0.0:1788526668.248495:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f68d880 x1875405881536000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526668.248505:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881536000:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248546:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881535360:0@lo:400:kworker.0 00000100:00100000:0.0:1788526668.248556:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881535872:0@lo:400:kworker.0 00010000:00080000:0.0:1788526668.248578:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f68f100 x1875405881535744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526668.248587:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881535744:0@lo:400:kworker.0 00000004:00080000:2.0:1788526668.248915:0:7907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303589526174ns, next at 304589522688ns, rc = 0 00000100:00100000:2.0:1788526668.248938:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526668.248949:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c141d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881536128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526668.248992:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526668.249054:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536128 00000100:00100000:2.0:1788526668.249060:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536128 00000100:00100000:2.0:1788526668.249098:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788526668.249107:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881536128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526668.249218:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526668.249260:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881536128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526668.249266:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788526668.249303:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c141d61f80 x1875405881536128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526668.249326:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c141d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881536128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788526669.011920:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526669.267999:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881536256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526669.268123:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526669.268374:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536256 00000100:00100000:1.0:1788526669.268414:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536256 00000100:00100000:1.0:1788526669.268485:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788526669.268498:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881536256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526669.268549:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526669.268617:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881536256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526669.268638:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788526669.268689:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c2430a6300 x1875405881536256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526669.268713:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881536256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526669.480164:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526669.480216:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526669.480267:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526669.480305:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526669.480364:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914816 00000100:00100000:1.0:1788526669.480378:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914816 00000100:00100000:1.0:1788526669.480495:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915072 00000100:00100000:1.0:1788526669.480498:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915072 00000100:00100000:1.0:1788526669.480529:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:1.0:1788526669.480541:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:2350:x1875405868914816:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526669.480810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914688 00000100:00100000:0.0:1788526669.480816:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914688 00000100:00100000:0.0:1788526669.480853:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 276 00000100:00100000:0.0:1788526669.480861:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868914688:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526669.480932:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:2350:x1875405868914816:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 392us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526669.480941:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:1.0:1788526669.480960:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:1.0:1788526669.480966:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868915072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526669.481068:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868914944 00000100:00100000:3.0:1788526669.481080:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868914944 00000100:00100000:3.0:1788526669.481120:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1788526669.481128:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868914944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526669.488763:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868914688:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 7885us (8599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526669.488782:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 276 00000100:00100000:1.0:1788526669.489218:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868915072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8248us (8908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526669.489233:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00080000:1.0:1788526669.489280:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526669.489290:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526669.491131:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868914944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 9989us (10899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526669.491150:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00010000:00010000:1.0:1788526670.036656:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788526670.121366:0:11606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1788526670.360169:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788526670.360195:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788526670.360218:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788526670.360632:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526670.360663:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881536384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788526670.360789:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526670.362331:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536384 00000100:00100000:3.0:1788526670.362350:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536384 00000100:00100000:3.0:1788526670.362483:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788526670.362497:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881536384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788526670.362544:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788526670.362595:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ac048, atime: 0x6a9ac048, ctime: 0x6a9ac048, blocks: 0x1 00010000:00010000:3.0:1788526670.362605:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526670.362627:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:3.0:1788526670.362633:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526670.362641:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526670.362665:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526670.362677:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526670.362687:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526670.362726:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526670.362787:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526670.362796:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526670.362805:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526670.362811:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526670.362822:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526670.362857:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526670.362865:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000590116d8/0x367645d450b3a437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526670.362899:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526670.362902:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526670.362904:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526670.363636:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881536384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1137us (2843us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788526670.363645:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788526670.363877:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788526670.365166:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27469dc00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788526670.365187:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881536384:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788526671.059970:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788526671.363740:0:11655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff93549100 20000000:00000080:1.0:1788526671.363763:0:11655:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c245541400 uarg=0000000000000000 20000000:01000000:1.0:1788526671.363813:0:11655:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788526671.363821:0:11655:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788526671.363827:0:11655:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788526671.365360:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788526671.365839:0:11655:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788526671.378329:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788526671.378428:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788526671.378483:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788526671.378506:0:11655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788526671.378533:0:11655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.378555:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.378564:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.378571:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.380722:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.380785:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.380796:0:11655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.380885:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.380902:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 13 pid: 5818 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526671.380929:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536512:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526671.382045:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.382074:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 13 pid: 5815 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526671.382087:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536640:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526671.382137:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.382146:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526671.382156:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536768:0@lo:104: 00000100:00100000:1.0:1788526671.382207:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788526671.382264:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.382272:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 20 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526671.382281:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536896:0@lo:104: 00000100:00100000:1.0:1788526671.382300:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788526671.382330:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.382338:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 20 pid: 5815 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526671.382346:0:11655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881537024:0@lo:104: 00000100:00100000:1.0:1788526671.382363:0:11655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526671.382372:0:11655:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327480 going to sleep for 11 seconds 00000100:00100000:1.0:1788526671.382445:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536768 00000100:00100000:1.0:1788526671.382454:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536768 00000100:00100000:1.0:1788526671.382502:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881536896 00000100:00100000:1.0:1788526671.382504:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881536896 00000100:00100000:1.0:1788526671.382513:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537024 00000100:00100000:1.0:1788526671.382515:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537024 00000100:00100000:1.0:1788526671.382528:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788526671.382537:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:11655:x1875405881536768:12345-0@lo:104: 00010000:00010000:1.0:1788526671.382553:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526671.386214:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788526671.386236:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+5:11655:x1875405881536768:12345-0@lo:104: Request processed in 3692us (4021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526671.386250:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788526671.386297:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788526671.386309:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11655:x1875405881536896:12345-0@lo:104: 00010000:00010000:0.0:1788526671.386329:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526671.386432:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788526671.386437:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+4:11655:x1875405881536896:12345-0@lo:104: Request processed in 134us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526671.386462:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788526671.386474:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788526671.386480:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:11655:x1875405881537024:12345-0@lo:104: 00010000:00010000:0.0:1788526671.386488:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526671.386522:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788526671.386527:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+3:11655:x1875405881537024:12345-0@lo:104: Request processed in 47us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526671.386533:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788526671.386661:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788526671.386670:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386689:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526671.386695:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386705:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526671.386712:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526671.386718:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526671.386776:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386784:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526671.386811:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386817:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b55600/0x367645d450b3a2f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2fc expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386831:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526671.386834:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386840:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662200 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526671.386843:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386860:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526671.386866:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526671.386872:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526671.386885:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386890:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526671.386895:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386902:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a2e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2ee expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386910:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526671.386913:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386918:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044000 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526671.386921:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386927:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526671.386933:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526671.386955:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526671.386971:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.386978:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788526671.386995:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.387002:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282044000/0x367645d450b3a2d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3a2e0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526671.387017:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526671.387018:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526671.387020:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526671.387037:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881537280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526671.387191:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526671.387280:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526671.387287:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881537152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526671.387314:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526671.387672:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536768:0@lo:104: 00000100:00100000:3.0:1788526671.387686:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536896:0@lo:104: 00000100:00100000:3.0:1788526671.387694:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881537024:0@lo:104: 00010000:00010000:2.0:1788526671.387788:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526671.387796:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526671.388614:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881537408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526671.388680:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526671.388925:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537280 00000100:00100000:0.0:1788526671.388935:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537280 00010000:00010000:0.0:1788526671.388991:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 21 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526671.389074:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537152 00000100:00100000:0.0:1788526671.389078:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537152 00010000:00010000:0.0:1788526671.389092:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 22 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.389135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526671.389150:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+22:3281:x1875405881537280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.389170:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526671.389177:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 22 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389190:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 22 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389210:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e820400/0x367645d450b3a2ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a2e7 expref: 22 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389226:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526671.389294:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881537280:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526671.389302:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526671.389323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788526671.389329:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3281:x1875405881537152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.389336:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526671.389341:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389350:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389360:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821400/0x367645d450b3a2fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a2f5 expref: 20 pid: 5817 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.389369:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526671.389413:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3281:x1875405881537152:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526671.389420:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788526671.389724:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526671.389785:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526671.389828:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881537152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526671.389838:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881537280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526671.389973:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537408 00000100:00100000:2.0:1788526671.389979:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537408 00010000:00010000:2.0:1788526671.390001:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.390015:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915200 00000100:00100000:2.0:1788526671.390017:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915200 00010000:00010000:2.0:1788526671.390031:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 14 pid: 5818 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.390043:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915328 00000100:00100000:2.0:1788526671.390110:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915328 00010000:00010000:2.0:1788526671.390127:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 15 pid: 5815 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.390142:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788526671.390148:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3278:x1875405881537408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.390156:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526671.390160:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390170:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390182:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55200/0x367645d450b3a2e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3a2d9 expref: 19 pid: 5815 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390194:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526671.390234:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3278:x1875405881537408:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526671.390241:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788526671.390255:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:2.0:1788526671.390260:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+15:2349:x1875405868915200:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.390268:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526671.390272:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 15 pid: 5818 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390282:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 15 pid: 5818 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390301:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526671.390345:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+15:2349:x1875405868915200:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 85us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526671.390351:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:2.0:1788526671.390364:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1788526671.390370:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868915328:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.390377:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526671.390381:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 14 pid: 5815 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390415:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 14 pid: 5815 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390429:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390438:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390458:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390466:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390473:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390480:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390495:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526671.390501:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390510:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390520:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.390535:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526671.390556:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868915328:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 187us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526671.390563:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1788526671.390697:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881537408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526671.392531:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54e00/0x367645d450b3a30a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59381 expref: 13 pid: 5818 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.392557:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536512:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526671.392569:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821c00/0x367645d450b3a303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5937a expref: 12 pid: 5815 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526671.392578:0:11655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1875405881536640:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526671.392687:0:11655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.392698:0:11655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.392728:0:11655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526671.392735:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241662800/0x367645d450b3a43e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526672.084964:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788526672.979506:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:0.0:1788526672.979517:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c274ba0000 from 7 10000000:01000000:0.0:1788526672.979524:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788526672.979595:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526672.979610:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526672.979623:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526672.979677:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788526672.979779:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526672.979869:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2490f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788526672.979978:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537536 00000100:00100000:2.0:1788526672.979990:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537536 00000100:00100000:2.0:1788526672.980075:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788526672.980087:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:5820:x1875405881537536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526672.980104:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526672.980124:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c76600/0x367645d450b3a44c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a445 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526672.980155:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c76600/0x367645d450b3a44c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a445 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526672.980168:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c76600/0x367645d450b3a44c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a445 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526672.980181:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76600, rc 0) 00000100:00100000:2.0:1788526672.980266:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526672.980274:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788526672.980513:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526672.980535:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526672.980547:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526672.981112:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000040:00080000:3.0:1788526672.989125:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526672.994980:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788526672.995089:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788526672.996515:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788526672.997335:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788526672.997698:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788526672.997978:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788526672.997988:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:3.0:1788526672.998150:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526672.998267:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526672.998335:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526672.999579:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537664 00000100:00100000:0.0:1788526672.999594:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537664 00000100:00100000:0.0:1788526672.999676:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788526672.999687:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526673.000231:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 543us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.000241:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788526673.000656:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.000725:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.000864:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.000916:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526673.000976:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537792 00000100:00100000:0.0:1788526673.000984:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537792 00000100:00100000:0.0:1788526673.001084:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788526673.001095:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788526673.001308:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.001316:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788526673.001449:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788526673.002109:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526673.002198:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537920:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.002260:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.011853:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551900 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.012419:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881537920 00000100:00100000:2.0:1788526673.012437:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881537920 00000100:00100000:2.0:1788526673.012529:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788526673.012542:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537920:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.018928:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881537920:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.019813:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881537920:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 7011us (17289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.019829:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000040:00080000:2.0:1788526673.020706:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788526673.021315:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788526673.021379:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788526673.023044:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788526673.023093:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788526673.023679:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788526673.024268:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788526673.024322:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788526673.024444:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c141d61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538048:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.024584:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526673.024649:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2461e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526673.024961:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538048 00000100:00100000:1.0:1788526673.024973:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538048 00000100:00100000:1.0:1788526673.025043:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788526673.025054:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881538048:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526673.025339:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881538048:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 286us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.025348:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788526673.025621:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c141d61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538048:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788526673.025818:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788526673.025835:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788526673.036623:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526673.036644:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526673.036647:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788526673.036655:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c274ba0000 00000020:00000080:2.0:1788526673.036657:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788526673.037057:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526673.037063:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526673.037065:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788526673.037069:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788526673.037973:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788526673.037994:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526673.038008:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.038024:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526673.038046:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:1.0:1788526673.038049:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27453b800 from 7 10000000:01000000:1.0:1788526673.038054:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788526673.038113:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.038124:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.038138:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526673.038173:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526673.038274:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.038343:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327480 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.040216:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538176 00000100:00100000:2.0:1788526673.040232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538176 00000100:00100000:2.0:1788526673.040308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788526673.040322:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:5820:x1875405881538176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526673.040347:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526673.040407:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c76e00/0x367645d450b3a45a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a453 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526673.040453:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c76e00/0x367645d450b3a45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a453 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526673.040467:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c76e00/0x367645d450b3a45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a453 expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526673.040478:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76e00, rc 0) 00000100:00100000:2.0:1788526673.040597:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.040605:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788526673.040918:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526673.040944:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526673.040955:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526673.041526:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:3.0:1788526673.043238:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526673.046506:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788526673.046607:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:3.0:1788526673.046657:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:3.0:1788526673.046694:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:3.0:1788526673.047123:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:3.0:1788526673.047315:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:3.0:1788526673.047324:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:3.0:1788526673.051312:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.051436:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.051495:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526673.051665:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538304 00000100:00100000:0.0:1788526673.051676:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538304 00000100:00100000:0.0:1788526673.051748:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788526673.051760:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526673.052115:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.052131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788526673.052412:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.052462:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.052508:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.052536:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526673.053859:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538432 00000100:00100000:0.0:1788526673.053872:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538432 00000100:00100000:0.0:1788526673.053943:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788526673.053954:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788526673.054851:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 895us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.054864:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788526673.055187:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788526673.058250:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526673.058845:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538560:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.058972:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.059031:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.059495:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538560 00000100:00100000:2.0:1788526673.059506:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538560 00000100:00100000:2.0:1788526673.059646:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788526673.059658:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538560:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.060382:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538560:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 723us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.060427:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788526673.061286:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538560:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526673.062370:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788526673.063584:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:3.0:1788526673.063698:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:3.0:1788526673.063750:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:3.0:1788526673.063785:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:3.0:1788526673.063830:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:3.0:1788526673.063864:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:3.0:1788526673.063892:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:3.0:1788526673.063977:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538688:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.064100:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.067813:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788526673.070946:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788526673.076109:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538688 00000100:00100000:0.0:1788526673.076145:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538688 00000100:00100000:0.0:1788526673.076226:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788526673.076237:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538688:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788526673.076601:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538688:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 365us (12499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.076609:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788526673.076974:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538688:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788526673.077194:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788526673.077213:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788526673.083122:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526673.083147:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526673.083150:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788526673.083158:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27453b800 00000020:00000080:0.0:1788526673.083160:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788526673.083255:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526673.083259:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526673.083260:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788526673.083263:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:3.0:1788526673.083479:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788526673.083498:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788526673.083513:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526673.083527:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526673.083542:0:5820:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788526673.083545:0:5820:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c248515800 from 7 10000000:01000000:3.0:1788526673.084044:0:5820:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526673.084101:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526673.084112:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526673.084127:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526673.084171:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.084264:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.084319:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526673.086147:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538816 00000100:00100000:0.0:1788526673.086168:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538816 00000100:00100000:0.0:1788526673.086264:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788526673.086286:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:5820:x1875405881538816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526673.086330:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526673.086366:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821c00/0x367645d450b3a468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3a461 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526673.086433:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821c00/0x367645d450b3a468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3a461 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526673.086448:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821c00/0x367645d450b3a468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3a461 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526673.086459:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821c00, rc 0) 00000100:00100000:0.0:1788526673.086570:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881538816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.086578:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788526673.088828:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526673.088870:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526673.088919:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526673.089008:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.089085:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.089159:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.089628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881538944 00000100:00100000:2.0:1788526673.089638:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881538944 00000100:00100000:2.0:1788526673.089695:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788526673.089706:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881538944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.090099:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881538944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 395us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.090108:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788526673.090175:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881538944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.090236:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c141d63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881539072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.090284:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526673.090308:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2461e6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.090322:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539072 00000100:00100000:2.0:1788526673.090326:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539072 00000100:00100000:2.0:1788526673.090343:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788526673.090349:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881539072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526673.090545:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:5820:x1875405881539072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.090553:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788526673.090588:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c141d63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:5820:1875405881539072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.100583:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:11674:1875405881539200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526673.100707:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.100777:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526673.100982:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539200 00000100:00100000:0.0:1788526673.100992:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539200 00000100:00100000:0.0:1788526673.101050:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788526673.101060:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:11674:x1875405881539200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788526673.101969:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:11674:x1875405881539200:12345-0@lo:502:llog_process_th.0 Request processed in 906us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526673.101982:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788526673.102121:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:11674:1875405881539200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526673.102235:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526673.102247:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526673.102250:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788526673.102260:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c248515800 00000020:00000080:3.0:1788526673.102263:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788526673.102377:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:11674:1875405881539328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526673.102450:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526673.102470:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526673.103876:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539328 00000100:00100000:2.0:1788526673.103892:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539328 00000100:00100000:2.0:1788526673.103970:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788526673.103982:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:11674:x1875405881539328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526673.105517:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:11674:x1875405881539328:12345-0@lo:502:llog_process_th.0 Request processed in 1528us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526673.105531:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788526673.105680:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:11674:1875405881539328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526673.105812:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526673.105821:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526673.105824:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788526673.105831:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788526673.109483:0:5820:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788526673.109510:0:5820:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788526673.109525:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526673.109542:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526673.119862:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526673.364610:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526673.364644:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881539456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526673.364775:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.364994:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539456 00000100:00100000:1.0:1788526673.365013:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539456 00000100:00100000:1.0:1788526673.365108:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788526673.365121:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881539456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526673.365168:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526673.365333:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881539456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.365342:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788526673.365448:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881539456:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788526673.365771:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526673.366580:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881539712:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.366645:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.366683:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526673.366688:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881539584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.366709:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.366740:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539712 00000100:00100000:1.0:1788526673.366745:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539712 00000100:00100000:1.0:1788526673.366792:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539584 00000100:00100000:1.0:1788526673.366794:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539584 00000100:00100000:1.0:1788526673.366814:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788526673.366821:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881539712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.366869:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881539712:12345-0@lo:400:kworker.0 Request processed in 48us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.366877:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788526673.366892:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788526673.366912:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881539584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.366942:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881539584:12345-0@lo:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.366961:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788526673.367008:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881539584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367020:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881539712:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367040:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881539840:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367066:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.367086:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526673.367091:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881539968:0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367110:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526673.367135:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539840 00000100:00100000:1.0:1788526673.367138:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539840 00000100:00100000:1.0:1788526673.367176:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788526673.367182:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881539840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367217:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881539840:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.367223:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788526673.367237:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881539968 00000100:00100000:1.0:1788526673.367240:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881539968 00000100:00100000:1.0:1788526673.367259:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788526673.367265:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881539968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526673.367291:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881539968:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.367297:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788526673.367322:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881539968:0@lo:400:kworker.0 00010000:00080000:1.0:1788526673.367336:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14401bb80 x1875405881539840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526673.367354:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881539840:0@lo:400:kworker.0 00000100:00080000:1.0:1788526673.367430:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526673.367435:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526673.382959:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526673.384118:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915456 00000100:00100000:1.0:1788526673.384138:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915456 00000100:00100000:1.0:1788526673.384209:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:1.0:1788526673.384220:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+12:5591:x1875405868915456:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526673.384245:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526673.384269:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241663000/0x367645d450b3a46f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593ce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.384308:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241663000/0x367645d450b3a46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ce expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.384322:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241663000/0x367645d450b3a46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ce expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.384333:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241663000, rc 0) 00000100:00100000:1.0:1788526673.384424:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868915456:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 205us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.384432:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:2.0:1788526673.397492:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.397943:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915584 00000100:00100000:3.0:1788526673.397958:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915584 00000100:00100000:3.0:1788526673.398041:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:3.0:1788526673.398052:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868915584:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.398449:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868915584:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 397us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.398463:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:3.0:1788526673.400678:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.400721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915712 00000100:00100000:3.0:1788526673.400733:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915712 00000100:00100000:3.0:1788526673.400794:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:3.0:1788526673.400806:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868915712:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.401085:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868915712:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 280us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.401094:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:1.0:1788526673.419776:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.420161:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915840 00000100:00100000:3.0:1788526673.420175:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915840 00000100:00100000:3.0:1788526673.420246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:3.0:1788526673.420257:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:9950:x1875405868915840:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788526673.420589:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+13:9950:x1875405868915840:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 332us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.420597:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:0.0:1788526673.429540:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.429629:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868915968 00000100:00100000:3.0:1788526673.429661:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868915968 00000100:00100000:3.0:1788526673.429750:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 296 00000100:00100000:3.0:1788526673.429762:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:9950:x1875405868915968:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788526673.430084:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+13:9950:x1875405868915968:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 323us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.430093:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 296 00000100:00100000:3.0:1788526673.436876:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526673.437275:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916096 00000100:00100000:1.0:1788526673.437290:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916096 00000100:00100000:1.0:1788526673.437431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:1.0:1788526673.437443:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+13:5591:x1875405868916096:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526673.437487:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526673.437511:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c241663400/0x367645d450b3a476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593d5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.437547:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c241663400/0x367645d450b3a476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593d5 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.437561:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c241663400/0x367645d450b3a476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593d5 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526673.437572:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241663400, rc 0) 00000100:00100000:1.0:1788526673.437649:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868916096:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 198us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.437657:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:0.0:1788526673.445618:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.445802:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916224 00000100:00100000:3.0:1788526673.445815:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916224 00000100:00100000:3.0:1788526673.445884:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 298 00000100:00100000:3.0:1788526673.445894:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868916224:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.447276:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245188c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868916224:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 1366us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.447294:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 298 00000100:00100000:0.0:1788526673.466679:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.466815:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916352 00000100:00100000:3.0:1788526673.466829:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916352 00000100:00100000:3.0:1788526673.466887:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:3.0:1788526673.466909:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868916352:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526673.467221:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:5591:x1875405868916352:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 323us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526673.467230:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:0.0:1788526673.474089:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526673.474232:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916480 00000100:00100000:3.0:1788526673.474256:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916480 00000100:00100000:3.0:1788526673.474323:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 300 00000100:00100000:3.0:1788526673.474334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:9953:x1875405868916480:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788526673.477131:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c24518b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:9953:x1875405868916480:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 2780us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.477152:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 300 00000100:00100000:0.0:1788526673.484445:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526673.484608:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916608 00000100:00100000:1.0:1788526673.484623:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916608 00000100:00100000:1.0:1788526673.484704:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:1.0:1788526673.484715:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:9953:x1875405868916608:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788526673.485037:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245189c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:9953:x1875405868916608:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 323us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526673.485047:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 301 00010000:00010000:2.0:1788526674.131744:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788526674.132347:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788526674.387728:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526674.393159:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881540096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526674.393274:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526674.395162:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540096 00000100:00100000:0.0:1788526674.395182:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540096 00000100:00100000:0.0:1788526674.396829:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788526674.396857:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881540096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526674.396927:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526674.397135:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881540096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 292us (3859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526674.397143:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788526674.398456:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14401bb80 x1875405881540096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526674.399000:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881540096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526674.585978:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526674.586031:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526674.586063:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526674.586105:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526674.586145:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916864 00000100:00100000:0.0:1788526674.586159:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916864 00000100:00100000:0.0:1788526674.586238:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917120 00000100:00100000:0.0:1788526674.586242:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917120 00000100:00100000:2.0:1788526674.586329:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916992 00000100:00100000:2.0:1788526674.586334:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916992 00000100:00100000:2.0:1788526674.586417:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1788526674.586430:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868916992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526674.586560:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868916992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 131us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526674.586569:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1788526674.586627:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1788526674.586636:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868916864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526674.586669:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868916864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526674.586676:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00080000:2.0:1788526674.586702:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526674.586708:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526674.587084:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1788526674.587093:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868917120:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526674.587129:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868917120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526674.587136:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:1.0:1788526674.587231:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868916736 00000100:00100000:1.0:1788526674.587238:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868916736 00000100:00100000:1.0:1788526674.587294:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00100000:1.0:1788526674.587309:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868916736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526674.587360:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868916736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 53us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526674.587368:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00080000:2.0:1788526674.589046:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526675.155880:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788526675.520548:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1788526676.181093:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526677.206075:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526678.228821:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526678.484030:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881540352:0@lo:400:kworker.0 00000100:00100000:1.0:1788526678.484161:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526678.484244:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881540864:0@lo:400:kworker.0 00000100:00100000:1.0:1788526678.484275:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526678.484316:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526678.484322:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881540480:0@lo:400:kworker.0 00000100:00100000:1.0:1788526678.484344:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526678.484382:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540864 00000100:00100000:1.0:1788526678.484415:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540864 00000100:00100000:1.0:1788526678.484489:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526678.484500:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881540864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526678.484566:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881540864:12345-0@lo:400:kworker.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526678.484574:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526678.484625:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788526678.484632:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27469dc00, transno 4294967300 00000100:00100000:1.0:1788526678.484646:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881540864:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485113:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881540608:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485160:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526678.485198:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788526678.485205:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881540224:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485237:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526678.485259:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881540736:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485280:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526678.485311:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540352 00000100:00100000:2.0:1788526678.485317:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540352 00000100:00100000:2.0:1788526678.485350:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540480 00000100:00100000:2.0:1788526678.485353:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540480 00000100:00100000:2.0:1788526678.485368:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540736 00000100:00100000:2.0:1788526678.485370:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540736 00000100:00100000:2.0:1788526678.485405:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788526678.485434:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485485:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881540352:12345-0@lo:400:kworker.0 Request processed in 53us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526678.485492:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788526678.485507:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788526678.485514:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881540480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485545:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881540480:12345-0@lo:400:kworker.0 Request processed in 32us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526678.485552:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788526678.485563:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788526678.485568:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485597:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881540736:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526678.485602:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788526678.485618:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526678.485623:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526678.485645:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881540736:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485672:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881540480:0@lo:400:kworker.0 00000100:00100000:2.0:1788526678.485682:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14401b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881540352:0@lo:400:kworker.0 00000100:00100000:0.0:1788526678.485912:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540224 00000100:00100000:0.0:1788526678.485918:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540224 00000100:00100000:0.0:1788526678.485949:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788526678.485957:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526678.486003:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881540224:12345-0@lo:400:kworker.0 Request processed in 47us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526678.486010:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788526678.486051:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881540224:0@lo:400:kworker.0 00000100:00100000:0.0:1788526678.487956:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526678.487981:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526678.488058:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526678.488124:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540992 00000100:00100000:0.0:1788526678.488132:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540992 00000100:00100000:0.0:1788526678.488186:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788526678.488195:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881540992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526678.488235:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526678.488287:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526678.488295:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788526678.488344:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526678.489336:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881540608 00000100:00100000:1.0:1788526678.489348:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881540608 00000100:00100000:1.0:1788526678.489448:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788526678.489458:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881540608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526678.489561:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881540608:12345-0@lo:400:kworker.0 Request processed in 105us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526678.489568:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788526678.490974:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c14211ce00 x1875405881540608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526678.490995:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881540608:0@lo:400:kworker.0 00000100:00080000:2.0:1788526678.491218:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788526679.252974:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526679.511935:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526679.511967:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881541120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526679.512070:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526679.513144:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541120 00000100:00100000:1.0:1788526679.513158:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541120 00000100:00100000:1.0:1788526679.513243:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788526679.513254:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881541120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526679.513303:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526679.513442:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881541120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 189us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526679.513450:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788526679.513995:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f714700 x1875405881541120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526679.514021:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881541120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526679.705764:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526679.705822:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526679.705865:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526679.705963:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526679.706193:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917504 00000100:00100000:2.0:1788526679.706208:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917504 00000100:00100000:2.0:1788526679.706290:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1788526679.706303:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868917504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526679.706548:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868917504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 247us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526679.706658:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917376 00000100:00100000:3.0:1788526679.706663:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917376 00000100:00100000:3.0:1788526679.706700:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917632 00000100:00100000:3.0:1788526679.706703:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917632 00000100:00100000:3.0:1788526679.706728:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:3.0:1788526679.706736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868917376:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526679.706773:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868917376:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526679.706794:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:3.0:1788526679.706816:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:3.0:1788526679.706834:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868917632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526679.706864:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868917632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526679.706871:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:2.0:1788526679.707321:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00080000:2.0:1788526679.707348:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526679.707354:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526679.711086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917248 00000100:00100000:1.0:1788526679.711111:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917248 00000100:00100000:1.0:1788526679.711257:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 304 00000100:00100000:1.0:1788526679.711269:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868917248:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526679.711414:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868917248:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 147us (5547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526679.711430:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 304 00010000:00010000:3.0:1788526680.278011:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526681.300214:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526682.324779:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526683.349028:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526683.603863:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881541248:0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.603863:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881541376:0@lo:400:kworker.0 00000100:00100000:2.0:1788526683.604074:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881541632:0@lo:400:kworker.0 00000100:00100000:1.0:1788526683.604135:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881541504:0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.610870:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526683.610967:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881541888:0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.611005:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526683.611074:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541888 00000100:00100000:0.0:1788526683.611083:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541888 00000100:00100000:0.0:1788526683.611150:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788526683.611161:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881541888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.611222:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881541888:12345-0@lo:400:kworker.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526683.611228:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788526683.613091:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881541888:0@lo:400:kworker.0 00000100:00080000:0.0:1788526683.613179:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788526683.613503:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541376 00000100:00100000:0.0:1788526683.613510:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541376 00000100:00100000:0.0:1788526683.613554:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788526683.613563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881541376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.613644:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881541376:12345-0@lo:400:kworker.0 Request processed in 82us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526683.613651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788526683.613681:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881541376:0@lo:400:kworker.0 00000100:00100000:3.0:1788526683.615034:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526683.615085:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881541760:0@lo:400:kworker.0 00000100:00100000:3.0:1788526683.615126:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526683.615162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541760 00000100:00100000:3.0:1788526683.615169:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541760 00000100:00100000:2.0:1788526683.615193:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526683.615233:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788526683.615244:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881541760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526683.615245:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541632 00000100:00100000:2.0:1788526683.615252:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541632 00000100:00100000:3.0:1788526683.615295:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881541760:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526683.615303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788526683.615328:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526683.615353:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881541760:0@lo:400:kworker.0 00000100:00100000:2.0:1788526683.615489:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788526683.615497:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881541632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526683.615532:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881541632:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526683.615538:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788526683.615643:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f68c000 x1875405881541632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526683.615655:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881541632:0@lo:400:kworker.0 00000100:00100000:1.0:1788526683.615688:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526683.615735:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881542016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526683.615761:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541504 00000100:00100000:2.0:1788526683.615766:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541504 00000100:00100000:1.0:1788526683.615771:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526683.615814:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542016 00000100:00100000:1.0:1788526683.615819:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542016 00000100:00100000:1.0:1788526683.615853:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788526683.615870:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788526683.615881:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881542016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526683.615884:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881541504:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788526683.615917:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526683.615936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881541504:12345-0@lo:400:kworker.0 Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526683.615942:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788526683.615965:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881542016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526683.615974:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788526683.616006:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881541504:0@lo:400:kworker.0 00000100:00100000:1.0:1788526683.616024:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881542016:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788526683.618176:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526683.618186:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526683.620199:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881541248 00000100:00100000:0.0:1788526683.620215:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881541248 00000100:00100000:0.0:1788526683.620293:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788526683.620304:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881541248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526683.620453:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881541248:12345-0@lo:400:kworker.0 Request processed in 152us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526683.620461:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788526683.620591:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881541248:0@lo:400:kworker.0 00000040:00080000:3.0:1788526684.372132:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788526684.372493:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526684.628154:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526684.628192:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881542144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526684.628268:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526684.628454:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542144 00000100:00100000:0.0:1788526684.628464:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542144 00000100:00100000:0.0:1788526684.628537:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788526684.628557:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881542144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526684.628596:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526684.628656:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881542144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526684.628663:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788526684.629047:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f715c00 x1875405881542144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526684.629067:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881542144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526684.829024:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526684.829086:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526684.829229:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917760 00000100:00100000:1.0:1788526684.829240:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917760 00000100:00100000:1.0:1788526684.829328:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 306 00000100:00100000:1.0:1788526684.829341:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868917760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526684.829452:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868917760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 115us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526684.829460:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 306 00000100:00100000:3.0:1788526684.830508:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868917888 00000100:00100000:3.0:1788526684.830517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868917888 00000100:00100000:3.0:1788526684.830594:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:3.0:1788526684.830603:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868917888:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526684.830670:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868917888:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 68us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526684.830690:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00080000:0.0:1788526684.831622:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526684.833481:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526684.833634:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526684.836674:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918144 00000100:00100000:3.0:1788526684.836713:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918144 00000100:00100000:3.0:1788526684.836818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:3.0:1788526684.836829:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868918144:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526684.836920:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868918144:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 94us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526684.836929:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:0.0:1788526684.842950:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918016 00000100:00100000:0.0:1788526684.842968:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918016 00000100:00100000:0.0:1788526684.843101:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1788526684.843114:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2347:x1875405868918016:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:0.0:1788526684.843159:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a3b2 00000100:00080000:0.0:1788526684.843169:0:8450:0:(import.c:65:import_set_state_nolock()) ffff98c248200800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788526684.843218:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788526684.843703:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+2:2347:x1875405868918016:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 589us (10228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526684.843711:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:3.0:1788526684.843782:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526684.845171:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526684.845183:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526685.397133:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526685.699708:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:0.0:1788526685.699720:0:7631:0:(genops.c:885:class_export_put()) final put ffff98c248207800/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:2.0:1788526685.699757:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c248207800/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-OST0001 00000020:00000080:2.0:1788526685.701558:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c248200800 for lustre-OST0001 00010000:00010000:2.0:1788526686.419847:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526687.447351:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526688.472460:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526688.723987:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881542272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526688.724114:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526688.724371:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542272 00000100:00100000:0.0:1788526688.724382:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542272 00000100:00100000:0.0:1788526688.724479:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788526688.724492:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881542272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526688.724540:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526688.724619:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881542272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526688.724646:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788526688.724908:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881542272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788526688.725429:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526688.728024:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881542528:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728141:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526688.728207:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788526688.728214:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881542400:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728265:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526688.728300:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881542912:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728325:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526688.728365:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542528 00000100:00100000:1.0:1788526688.728375:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542528 00000100:00100000:1.0:1788526688.728496:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542912 00000100:00100000:1.0:1788526688.728500:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542912 00000100:00100000:1.0:1788526688.728540:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788526688.728549:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881542528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728626:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881542528:12345-0@lo:400:kworker.0 Request processed in 77us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526688.728634:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788526688.728666:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788526688.728673:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881542912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728703:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881542912:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526688.728709:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788526688.728729:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542400 00000100:00100000:1.0:1788526688.728734:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542400 00000100:00100000:1.0:1788526688.728760:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788526688.728766:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881542400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728800:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881542400:12345-0@lo:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526688.728807:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788526688.728847:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881542656:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728875:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526688.728897:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526688.728903:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881542784:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.728931:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788526688.728963:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526688.728974:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542656 00000100:00100000:1.0:1788526688.728978:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542656 00000100:00100000:1.0:1788526688.729016:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788526688.729023:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881542656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729057:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881542656:12345-0@lo:400:kworker.0 Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526688.729063:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788526688.729078:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526688.729113:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881542656:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729144:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881542400:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729155:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881542912:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729166:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881542528:0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729224:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881542784 00000100:00100000:1.0:1788526688.729228:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881542784 00000100:00100000:1.0:1788526688.729266:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788526688.729274:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881542784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526688.729312:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881542784:12345-0@lo:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526688.729319:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788526688.729337:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788526688.729356:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f717480 x1875405881542784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526688.729367:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881542784:0@lo:400:kworker.0 00010000:00010000:2.0:1788526689.493471:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526689.747677:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526689.747710:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881543040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526689.747830:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526689.748005:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543040 00000100:00100000:0.0:1788526689.748019:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543040 00000100:00100000:0.0:1788526689.748087:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788526689.748098:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881543040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526689.748150:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526689.748207:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881543040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526689.748216:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788526689.749149:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f717480 x1875405881543040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526689.749180:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881543040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526689.959878:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526689.959938:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526689.959982:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526689.960150:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918400 00000100:00100000:3.0:1788526689.960163:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918400 00000100:00100000:1.0:1788526689.960199:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918528 00000100:00100000:1.0:1788526689.960206:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918528 00000100:00100000:0.0:1788526689.960280:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918272 00000100:00100000:0.0:1788526689.960285:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918272 00000100:00100000:0.0:1788526689.960319:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 308 00000100:00100000:0.0:1788526689.960329:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868918272:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526689.960442:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868918272:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 113us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526689.960449:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 308 00000100:00100000:3.0:1788526689.960554:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:3.0:1788526689.960563:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868918400:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526689.960608:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868918400:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 47us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526689.960614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:3.0:1788526689.960629:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:3.0:1788526689.960635:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868918528:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526689.960654:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868918528:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 19us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526689.960660:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00080000:1.0:1788526689.960786:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788526690.515704:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526691.540125:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526692.567018:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526693.606883:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526693.845772:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881543168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526693.845849:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526693.845900:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526693.845906:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c281e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881543296:0@lo:400:kworker.0 00000100:00100000:1.0:1788526693.845930:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526693.845960:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543168 00000100:00100000:1.0:1788526693.845967:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543168 00000100:00100000:1.0:1788526693.846013:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526693.846022:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881543168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526693.846053:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526693.846092:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881543168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526693.846098:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526693.846128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543296 00000100:00100000:1.0:1788526693.846131:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543296 00000100:00100000:1.0:1788526693.846153:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788526693.846159:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881543296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526693.846185:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881543296:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526693.846191:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:1.0:1788526693.846212:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526693.846236:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c281e47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881543296:0@lo:400:kworker.0 00000100:00100000:1.0:1788526693.846252:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881543168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526693.846427:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881543424:0@lo:400:kworker.0 00000100:00100000:3.0:1788526693.846458:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526693.846523:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543424 00000100:00100000:1.0:1788526693.846527:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543424 00000100:00100000:1.0:1788526693.846553:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788526693.846559:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881543424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526693.846705:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881543424:12345-0@lo:400:kworker.0 Request processed in 146us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526693.846711:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788526693.846754:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881543424:0@lo:400:kworker.0 00000100:00100000:3.0:1788526693.846764:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526693.846769:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881543552:0@lo:400:kworker.0 00000100:00100000:3.0:1788526693.846790:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526693.846843:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543552 00000100:00100000:1.0:1788526693.846847:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543552 00000100:00100000:1.0:1788526693.846906:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788526693.846911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881543552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526693.846941:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881543552:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526693.846946:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788526693.847010:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881543808:0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.847035:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526693.847052:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526693.847056:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881543680:0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.847073:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526693.847095:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543808 00000100:00100000:2.0:1788526693.847098:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543808 00000100:00080000:3.0:1788526693.847207:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526693.847229:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881543552:0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.847368:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788526693.847374:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881543808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.847427:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881543808:12345-0@lo:400:kworker.0 Request processed in 53us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526693.847432:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788526693.847449:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543680 00000100:00100000:2.0:1788526693.847452:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543680 00000100:00080000:3.0:1788526693.847533:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788526693.848355:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881543808:0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.848493:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788526693.848512:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881543680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526693.848561:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881543680:12345-0@lo:400:kworker.0 Request processed in 61us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526693.848566:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788526693.848594:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26e62d880 x1875405881543680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526693.848605:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881543680:0@lo:400:kworker.0 00000040:00080000:2.0:1788526694.612016:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788526694.620909:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526694.872568:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881543936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526694.872667:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526694.872780:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881543936 00000100:00100000:0.0:1788526694.872791:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881543936 00000100:00100000:0.0:1788526694.872856:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788526694.872867:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881543936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526694.872903:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526694.872960:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881543936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526694.872977:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788526694.873018:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f717b80 x1875405881543936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526694.873037:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881543936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526695.075604:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526695.075640:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526695.075826:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918784 00000100:00100000:1.0:1788526695.075836:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918784 00000100:00100000:1.0:1788526695.075902:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:1.0:1788526695.075912:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868918784:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526695.075979:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868918784:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 69us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526695.075987:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00080000:3.0:1788526695.076044:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526695.076186:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526695.076247:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918912 00000100:00100000:1.0:1788526695.076251:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918912 00000100:00100000:1.0:1788526695.076288:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:1.0:1788526695.076295:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868918912:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526695.076327:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868918912:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526695.076333:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00080000:3.0:1788526695.076375:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526695.079027:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868918656 00000100:00100000:2.0:1788526695.079041:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868918656 00000100:00100000:2.0:1788526695.079104:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 310 00000100:00100000:2.0:1788526695.079113:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868918656:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526695.079192:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868918656:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526695.079200:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 310 00010000:00010000:3.0:1788526695.635850:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526696.662096:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788526697.100702:0:11843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:58:14 (1788526694) 00010000:00010000:3.0:1788526697.684065:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526698.707568:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526698.965186:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881544064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526698.965211:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881544192:0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.965310:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526698.965317:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526698.965378:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881544576:0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.965463:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526698.965497:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788526698.965503:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.965533:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526698.965572:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544192 00000100:00100000:0.0:1788526698.965580:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544192 00000100:00100000:0.0:1788526698.965632:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788526698.965642:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881544192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.965701:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881544192:12345-0@lo:400:kworker.0 Request processed in 60us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.965709:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788526698.965764:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881544192:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.965989:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881544320:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.966025:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526698.966046:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881544832:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.966064:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526698.966084:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526698.966091:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881544704:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.966115:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526698.966227:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544448 00000100:00100000:0.0:1788526698.966233:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544448 00000100:00100000:0.0:1788526698.966276:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544320 00000100:00100000:0.0:1788526698.966279:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544320 00000100:00100000:0.0:1788526698.966292:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544704 00000100:00100000:0.0:1788526698.966294:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544704 00000100:00100000:0.0:1788526698.966308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788526698.966315:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.966356:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881544448:12345-0@lo:400:kworker.0 Request processed in 41us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.966362:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788526698.966375:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788526698.966381:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881544320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.966445:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881544320:12345-0@lo:400:kworker.0 Request processed in 64us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.966452:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788526698.966463:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788526698.966470:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.966497:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881544704:12345-0@lo:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.966503:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788526698.966522:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544576 00000100:00100000:0.0:1788526698.966526:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544576 00000100:00100000:0.0:1788526698.966553:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544832 00000100:00100000:0.0:1788526698.966556:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544832 00000100:00100000:0.0:1788526698.966575:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788526698.966581:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881544576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.966625:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881544576:12345-0@lo:400:kworker.0 Request processed in 44us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.966632:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788526698.966643:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788526698.966648:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.966673:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881544832:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.966678:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788526698.966696:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544064 00000100:00100000:0.0:1788526698.966700:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544064 00000100:00100000:0.0:1788526698.966721:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788526698.966727:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881544064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526698.966760:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526698.967300:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881544704:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.967313:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881544320:0@lo:400:kworker.0 00000100:00100000:2.0:1788526698.967322:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881544832:0@lo:400:kworker.0 00000100:00100000:0.0:1788526698.968455:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881544064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526698.968466:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788526698.968536:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881544448:0@lo:400:kworker.0 00010000:00080000:0.0:1788526698.968552:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c27f68f800 x1875405881544576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788526714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526698.968564:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881544576:0@lo:400:kworker.0 00000100:00080000:3.0:1788526698.968928:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526698.968935:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526698.968937:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526698.977114:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881544064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526699.364342:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526699.364478:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919040 00000100:00100000:1.0:1788526699.364489:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919040 00000100:00100000:1.0:1788526699.364572:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1788526699.364583:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:10222:x1875405868919040:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526699.364605:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526699.364629:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a47d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593dc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364711:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364727:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364741:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526699.364777:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788526699.364781:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526699.364819:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364844:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a47d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593dc expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364876:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593dc expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.364903:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c272284200) 00010000:00010000:1.0:1788526699.364906:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526699.364910:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c241663800, rc 0) 00000100:00100000:1.0:1788526699.364976:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:10222:x1875405868919040:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 395us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526699.364983:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00080000:3.0:1788526699.367184:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526699.406473:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526699.406570:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919168 00000100:00100000:1.0:1788526699.406582:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919168 00000100:00100000:1.0:1788526699.406646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1788526699.406659:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:10223:x1875405868919168:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526699.406681:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526699.406714:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a48b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593e3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.406797:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.406813:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.406828:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.406987:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.406996:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407011:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407258:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407267:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407275:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526699.407303:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788526699.407307:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526699.407326:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407336:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407344:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407350:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407355:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526699.407359:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407366:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407433:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c272284200) 00010000:00010000:1.0:1788526699.407438:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526699.407442:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407448:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663e00/0x367645d450b3a492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407461:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407467:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407472:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407476:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526699.407478:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407484:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407489:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c272284f00) 00010000:00010000:1.0:1788526699.407491:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526699.407493:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407498:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a499 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407541:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241662800/0x367645d450b3a48b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593e3 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407555:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593e3 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.407562:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284500) 00010000:00010000:1.0:1788526699.407564:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526699.407566:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111400, rc 0) 00000100:00100000:1.0:1788526699.407643:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:10223:x1875405868919168:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 986us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526699.407652:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1788526699.420216:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526699.420328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919424 00000100:00100000:1.0:1788526699.420341:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919424 00000100:00100000:1.0:1788526699.420451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1788526699.420463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:10223:x1875405868919424:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526699.420492:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526699.420530:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a4a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593ea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420615:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420629:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420641:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420670:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420676:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.420683:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421043:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111600/0x367645d450b3a4bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421053:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111600/0x367645d450b3a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421060:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111600/0x367645d450b3a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526699.421069:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788526699.421220:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421228:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421235:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421240:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526699.421245:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421263:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421276:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284500) 00010000:00010000:1.0:1788526699.421279:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526699.421284:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421290:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a4ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421304:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421310:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421315:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421320:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526699.421323:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421329:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421336:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c272284f00) 00010000:00010000:1.0:1788526699.421338:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526699.421341:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421356:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a4b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421910:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a4a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ea expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421934:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111600/0x367645d450b3a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ea expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526699.421944:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:1.0:1788526699.421946:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526699.421949:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111600, rc 0) 00000100:00100000:1.0:1788526699.422013:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:10223:x1875405868919424:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1552us (1811us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788526699.422021:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1788526699.436605:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526699.436677:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919552 00000100:00100000:1.0:1788526699.436689:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919552 00000100:00100000:1.0:1788526699.436756:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:1.0:1788526699.436767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+9:10223:x1875405868919552:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788526699.436888:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+9:10223:x1875405868919552:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526699.436896:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000040:00080000:1.0:1788526699.732295:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788526699.732576:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526699.988561:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526699.988584:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881544960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526699.988656:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526699.988757:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881544960 00000100:00100000:0.0:1788526699.988766:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881544960 00000100:00100000:0.0:1788526699.988872:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788526699.988889:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881544960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526699.988925:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526699.988973:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881544960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526699.988980:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788526699.989038:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c26ece8700 x1875405881544960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526699.989057:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881544960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526700.187721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526700.187769:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526700.187800:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526700.187836:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919680 00000100:00100000:0.0:1788526700.187847:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919680 00000100:00100000:0.0:1788526700.187906:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:0.0:1788526700.187918:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868919680:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526700.187990:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868919680:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526700.187998:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:0.0:1788526700.188040:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919808 00000100:00100000:0.0:1788526700.188044:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919808 00000100:00100000:0.0:1788526700.188070:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868919936 00000100:00100000:0.0:1788526700.188073:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868919936 00000100:00100000:0.0:1788526700.188101:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1788526700.188107:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868919808:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526700.188138:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868919808:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526700.188160:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1788526700.188173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1788526700.188178:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868919936:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526700.188202:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868919936:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526700.188229:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00080000:3.0:1788526700.188435:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788526700.755544:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526701.058148:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788526701.781006:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526701.895314:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526701.895427:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920064 00000100:00100000:0.0:1788526701.895442:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920064 00000100:00100000:0.0:1788526701.895654:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00080000:2.0:1788526701.895667:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526701.895672:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:10266:x1875405868920064:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526701.895703:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526701.895732:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a4ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593f1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895820:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895840:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895854:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895872:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895879:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.895906:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896425:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896433:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896438:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896442:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526701.896446:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896453:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896567:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c272284200) 00010000:00010000:0.0:1788526701.896572:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526701.896578:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896586:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a4d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896658:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896663:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896675:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896678:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526701.896680:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896684:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896691:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98c243972500) 00010000:00010000:0.0:1788526701.896692:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526701.896694:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896698:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896734:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a4ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593f1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896741:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c272284200) 00010000:00010000:0.0:1788526701.896742:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526701.896745:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a4ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593f1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.896751:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526701.896833:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:10266:x1875405868920064:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1168us (1531us total) trans 0 rc 301/301 00000100:00100000:0.0:1788526701.896846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1788526701.901305:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526701.901750:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920320 00000100:00100000:2.0:1788526701.901766:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920320 00000100:00100000:2.0:1788526701.901941:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1788526701.901954:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+8:10266:x1875405868920320:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:2.0:1788526701.902037:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526701.902074:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c241663800/0x367645d450b3a484 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593dc expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902096:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c272284200) 00010000:00010000:2.0:1788526701.902109:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526701.902448:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902467:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902488:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902502:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902509:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.902516:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526701.903647:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788526701.903667:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903678:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903686:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903694:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526701.903699:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903708:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903723:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526701.903727:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526701.903737:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526701.903744:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a4df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526701.903765:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000bf73c5 reply state 000000000acfceef transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526701.903774:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526701.903942:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+9:10266:x1875405868920320:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 1985us (2646us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788526701.903952:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00010000:00010000:3.0:1788526701.906837:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906862:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906872:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906878:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526701.906884:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906894:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906946:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98c260d60600) 00010000:00010000:3.0:1788526701.906950:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526701.906956:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526701.906964:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a4e6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526701.977519:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526701.977645:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920448 00000100:00100000:0.0:1788526701.977663:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920448 00000100:00100000:0.0:1788526701.977789:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:0.0:1788526701.977806:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:10274:x1875405868920448:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:0.0:1788526701.977848:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526701.977885:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a4ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593f8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.977996:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.978016:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.978115:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526701.978170:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526701.978175:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526701.978307:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.978341:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a4ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593f8 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.978371:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593f8 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526701.978423:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526701.978426:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526701.978432:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821400, rc 0) 00000100:00100000:0.0:1788526701.978536:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:10274:x1875405868920448:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 734us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526701.978545:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1788526702.025616:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526702.025727:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920576 00000100:00100000:3.0:1788526702.025741:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920576 00000100:00100000:3.0:1788526702.025850:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1788526702.025863:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:10280:x1875405868920576:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526702.025892:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526702.025920:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a4fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc593ff expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026140:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026161:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026178:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026198:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026206:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026236:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026417:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026427:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026434:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526702.026472:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788526702.026476:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526702.026525:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026542:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026549:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026557:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026564:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526702.026569:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026579:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026604:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526702.026607:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526702.026614:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026635:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026641:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026647:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026653:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526702.026656:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026662:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026669:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98c242a8b500) 00010000:00010000:3.0:1788526702.026671:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526702.026674:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026680:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a509 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026728:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a4fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ff expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026743:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ff expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.026750:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526702.026753:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788526702.026755:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55800, rc 0) 00000100:00100000:3.0:1788526702.026900:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+10:10280:x1875405868920576:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1039us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526702.026908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1788526702.030645:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526702.030761:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920832 00000100:00100000:1.0:1788526702.030777:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920832 00000100:00100000:1.0:1788526702.030863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1788526702.030876:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+10:10280:x1875405868920832:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1788526702.030908:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526702.030941:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a517 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59406 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.031588:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.031611:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.031628:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.033984:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.034011:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.034027:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788526702.044776:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788526702.045032:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045051:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045079:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045135:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045142:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045150:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045155:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526702.045159:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045166:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045180:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526702.045183:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526702.045188:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045194:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3a51e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788526702.045208:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006017be90 reply state 000000005b4ea6c8 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526702.045218:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788526702.045263:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a517 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045281:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.045288:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:1.0:1788526702.045290:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526702.045838:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:1.0:1788526702.045930:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:10280:x1875405868920832:12345-192.168.204.59@tcp:101:bash.0 Request processed in 15056us (15300us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788526702.045940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00010000:00010000:2.0:1788526702.054760:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054780:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054788:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054794:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526702.054799:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054808:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054826:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c272284a00) 00010000:00010000:2.0:1788526702.054845:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526702.054852:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.054858:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a525 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526702.058022:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.058648:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868920960 00000100:00100000:0.0:1788526702.058665:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868920960 00000100:00100000:0.0:1788526702.058763:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1788526702.058775:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875405868920960:12345-192.168.204.59@tcp:8:bash.0 00010000:00080000:0.0:1788526702.058824:0:6671:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:0.0:1788526702.058870:0:6671:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a53a 00002000:00100000:0.0:1788526702.058888:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f122900d-e71c-4fc3-b559-b19040da7c34/ffff98c2461fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788526702.058921:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788526702.059423:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788526702.059466:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c2461f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526702.059627:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868920960:12345-192.168.204.59@tcp:8:bash.0 Request processed in 851us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.059636:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526702.075158:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.075446:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868921088 00000100:00100000:0.0:1788526702.075461:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868921088 00000100:00100000:0.0:1788526702.075557:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1788526702.075571:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:0:x1875405868921088:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526702.075599:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526702.075650:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5940d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526702.075692:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526702.075719:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1788526702.075724:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526702.075736:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.075762:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.075780:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:0.0:1788526702.075879:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:0:x1875405868921088:12345-192.168.204.59@tcp:101:bash.0 Request processed in 311us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.075887:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00080000:2.0:1788526702.075967:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526702.080135:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.080758:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868921216 00000100:00100000:2.0:1788526702.080774:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868921216 00000100:00100000:2.0:1788526702.080851:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1788526702.080863:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:10280:x1875405868921216:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526702.080888:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526702.080918:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59414 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.080960:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.080971:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526702.080977:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526702.080984:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.081033:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.081079:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 8 pid: 8450 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526702.081098:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6669:1875405881545088:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526702.082325:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526702.088087:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.088278:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868921344 00000100:00100000:0.0:1788526702.088292:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868921344 00010000:00010000:0.0:1788526702.088359:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 9 pid: 8450 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.088677:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:0.0:1788526702.088690:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:2348:x1875405868921344:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526702.088712:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526702.088742:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 9 pid: 8450 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.088785:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 9 pid: 8450 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.088821:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526702.088827:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526702.088839:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.088853:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.088907:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.088925:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881545216:192.168.204.59@tcp:105: 00000100:00100000:0.0:1788526702.089864:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788526702.092786:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3a541 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5940d expref: 9 pid: 8450 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526702.092822:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6669:1875405881545088:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526702.092867:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.092887:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76000, rc 0) 00000100:00100000:2.0:1788526702.095625:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:10280:x1875405868921216:12345-192.168.204.59@tcp:101:bash.0 Request processed in 14740us (15485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526702.095642:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1788526702.096120:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881545216:192.168.204.59@tcp:105: 00010000:00010000:2.0:1788526702.096150:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526702.096203:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868921344:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 7517us (8132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526702.096283:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:1.0:1788526702.105750:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.105850:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868921600 00000100:00100000:0.0:1788526702.105865:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868921600 00000100:00100000:0.0:1788526702.105948:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1788526702.105960:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+12:10280:x1875405868921600:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1788526702.106898:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:10280:x1875405868921600:12345-192.168.204.59@tcp:35:bash.0 Request processed in 936us (1160us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788526702.106910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1788526702.267379:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.267752:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868921856 00000100:00100000:2.0:1788526702.267767:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868921856 00000100:00100000:2.0:1788526702.267861:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1788526702.267875:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:10290:x1875405868921856:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526702.267914:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526702.267947:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5941b expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526702.268096:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788526702.268274:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a54f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5941b expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.268293:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:2.0:1788526702.268297:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526702.268303:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5941b expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.268322:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76400, rc 0) 00000100:00100000:2.0:1788526702.268613:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:10290:x1875405868921856:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 740us (1248us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788526702.268622:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1788526702.279949:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.281647:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868922112 00000100:00100000:2.0:1788526702.281674:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868922112 00000100:00100000:2.0:1788526702.281873:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1788526702.281887:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+14:10290:x1875405868922112:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526702.283614:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+15:10290:x1875405868922112:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1711us (3663us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788526702.283630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526702.342990:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.343154:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868922240 00000100:00100000:0.0:1788526702.343168:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868922240 00000100:00100000:0.0:1788526702.343244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1788526702.343255:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:10296:x1875405868922240:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526702.343288:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526702.343313:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a55d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59422 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343463:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343483:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343499:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526702.343550:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788526702.343554:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526702.343585:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343628:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a55d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59422 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343657:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59422 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.343668:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526702.343671:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526702.343699:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821800, rc 0) 00000100:00100000:0.0:1788526702.343806:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:10296:x1875405868922240:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 551us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.343815:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1788526702.352573:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.352885:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868922496 00000100:00100000:2.0:1788526702.352927:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868922496 00000100:00100000:2.0:1788526702.353033:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1788526702.353047:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+16:10296:x1875405868922496:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526702.353079:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526702.353106:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a56b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59429 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.353250:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.353271:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.353289:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526702.353304:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788526702.353738:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a56b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59429 expref: 19 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.353762:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59429 expref: 18 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.353773:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:2.0:1788526702.353777:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526702.353781:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76a00, rc 0) 00000100:00100000:2.0:1788526702.353870:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+18:10296:x1875405868922496:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 825us (1313us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788526702.353878:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1788526702.366762:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.366825:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.366957:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868922752 00000100:00100000:0.0:1788526702.366971:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868922752 00000100:00100000:0.0:1788526702.367077:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1788526702.367090:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+18:10296:x1875405868922752:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526702.367124:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526702.367155:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59430 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.367303:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.367324:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.367352:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526702.367369:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788526702.367836:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59430 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.367861:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59430 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.367872:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526702.367894:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788526702.367900:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526702.368059:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+20:10296:x1875405868922752:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 970us (1313us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788526702.368069:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1788526702.368255:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868922880 00000100:00100000:1.0:1788526702.368264:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868922880 00000100:00100000:1.0:1788526702.368319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1788526702.368327:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:2349:x1875405868922880:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526702.368352:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526702.368370:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59429 expref: 20 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.368426:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:1.0:1788526702.368439:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526702.368474:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:2349:x1875405868922880:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 147us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526702.368481:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1788526702.374782:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.375205:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923008 00000100:00100000:0.0:1788526702.375222:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923008 00000100:00100000:0.0:1788526702.375374:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1788526702.375426:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868923008:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:0.0:1788526702.375504:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.375532:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.375543:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526702.375549:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526702.375556:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.375612:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.375631:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.375652:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881545344:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526702.375813:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526702.380433:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.380750:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923136 00000100:00100000:2.0:1788526702.380765:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923136 00002000:00100000:2.0:1788526702.380830:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98c26eb70a80 x1875405868923136/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:418/0 lens 504/0 e 0 to 0 dl 1788526713 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788526702.380842:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26eb70a80 with x1875405868923136 ext(0->12) 00010000:00010000:2.0:1788526702.380853:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 8 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.380872:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 8 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788526702.380880:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c26eb70a80 00000100:00100000:2.0:1788526702.380916:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1788526702.380927:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868923136:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:1.0:1788526702.381109:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881545344:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526702.381146:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788526702.441471:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000001:00080000:3.0:1788526702.507835:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788526702.508210:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868923136:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 127277us (127785us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788526702.508226:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:2.0:1788526702.508243:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98c26eb70a80 x1875405868923136/t4294967299(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:418/0 lens 504/448 e 0 to 0 dl 1788526713 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788526702.508256:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26eb70a80 with x1875405868923136 ext(0->12) 00010000:00010000:2.0:1788526702.508269:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.508290:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788526702.508311:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c26eb70a80 00000100:00100000:2.0:1788526702.511095:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.511249:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923264 00000100:00100000:0.0:1788526702.511262:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923264 00010000:00010000:0.0:1788526702.511317:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.511381:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1788526702.511428:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2351:x1875405868923264:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526702.511448:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788526702.511574:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788526702.511578:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788526701 00002000:00010000:0.0:1788526702.511580:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788526701 00002000:00010000:0.0:1788526702.511582:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788526701 00002000:00010000:0.0:1788526702.511585:0:5808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788526702.511593:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.511609:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.511638:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8de60c7/0x367645d450b3a548 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59414 expref: 7 pid: 6669 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.511659:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526702.511665:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526702.511691:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.511703:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.511742:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526702.511813:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868923264:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 387us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.511822:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00010000:00010000:1.0:1788526702.511917:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.511930:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.511960:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.511968:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.511986:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.511994:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526702.512000:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.512018:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.512034:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.512043:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526702.512095:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868923008:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 136710us (137333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526702.512103:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1788526702.520829:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526702.522912:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923520 00000100:00100000:1.0:1788526702.522933:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923520 00000100:00100000:1.0:1788526702.523010:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1788526702.523021:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:10296:x1875405868923520:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:1.0:1788526702.523097:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59430 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526702.523616:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788526702.523679:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788526702.524906:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788526702.525001:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.525026:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.525044:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.525097:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.525322:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 23 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526702.525705:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881545472:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526702.525921:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526702.528642:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.528746:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923648 00000100:00100000:0.0:1788526702.528758:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923648 00010000:00010000:0.0:1788526702.528808:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 24 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.528862:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1788526702.528872:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+24:2349:x1875405868923648:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526702.528899:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526702.528908:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 24 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.528923:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 24 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.528951:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526702.528957:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.529081:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.529092:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.529116:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526702.529275:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a52c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59406 expref: 24 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526702.529298:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881545472:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526702.529325:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.529347:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526702.529355:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526702.529642:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788526702.529864:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788526702.529990:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881545600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788526702.531479:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+25:2349:x1875405868923648:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2592us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.531496:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1788526702.541171:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526702.541324:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b5510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526702.541616:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881545600 00000100:00100000:3.0:1788526702.541629:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881545600 00000100:00100000:3.0:1788526702.541774:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526702.541785:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881545600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788526702.541936:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881545600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526702.541944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788526702.542794:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788526702.542854:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881545600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788526702.545940:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788526702.546073:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881545728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788526702.546160:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526702.546428:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526702.548528:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881545728 00000100:00100000:3.0:1788526702.548551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881545728 00000100:00100000:3.0:1788526702.548663:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526702.548678:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881545728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788526702.550731:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875405881545728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2043us (4556us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788526702.550749:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526702.551323:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881545728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788526702.553651:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788526702.553748:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553763:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553772:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553779:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526702.553785:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553794:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553815:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:2.0:1788526702.553837:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788526702.553845:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.553852:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3a59c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526702.554165:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788526702.560549:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788526702.560575:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337901187495ns, next at 338901182110ns, rc = 0 00000001:00080000:3.0:1788526702.560598:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788526702.560692:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c272284d00) 00010000:00010000:3.0:1788526702.560697:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788526702.560714:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a587 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59430 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526702.561554:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+26:10296:x1875405868923520:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 38523us (40731us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788526702.561570:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000020:00080000:3.0:1788526702.561581:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788526702.568318:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.568624:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868923776 00000100:00100000:2.0:1788526702.568640:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868923776 00000100:00100000:2.0:1788526702.568731:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1788526702.569343:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+26:10296:x1875405868923776:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526702.569380:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526702.569462:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a5a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59437 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.569765:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59437 expref: 27 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.569784:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59437 expref: 27 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.569806:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526702.569810:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788526702.569815:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77400, rc 0) 00000100:00100000:0.0:1788526702.569902:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+27:10296:x1875405868923776:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1161us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.569910:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1788526702.579105:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.588067:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868924032 00000100:00100000:0.0:1788526702.588088:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868924032 00000100:00100000:0.0:1788526702.588187:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526702.588199:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+27:10296:x1875405868924032:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1788526702.588569:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+28:10296:x1875405868924032:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 370us (9577us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788526702.588597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1788526702.675083:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.675521:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868924288 00000100:00100000:0.0:1788526702.675534:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868924288 00000100:00100000:0.0:1788526702.675613:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:0.0:1788526702.675626:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+28:10306:x1875405868924288:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526702.675660:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526702.675691:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5943e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526702.675814:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788526702.675988:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5943e expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.676005:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526702.676008:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526702.676015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5943e expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.676031:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821200, rc 0) 00000100:00100000:0.0:1788526702.676119:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+29:10306:x1875405868924288:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 495us (1052us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788526702.676127:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1788526702.681215:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526702.681524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868924416 00000100:00100000:3.0:1788526702.681537:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868924416 00000100:00100000:3.0:1788526702.681607:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:3.0:1788526702.681620:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+29:10306:x1875405868924416:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1788526702.681734:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681755:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681772:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681803:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681811:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681818:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681925:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681933:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.681941:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526702.682003:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.682018:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683183:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683202:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683210:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526702.683216:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683239:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683256:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526702.683259:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526702.683265:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683273:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a5b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683290:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683297:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683304:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683309:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526702.683312:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683317:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683324:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526702.683327:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526702.683340:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683356:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a5bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683375:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683382:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683586:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683591:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526702.683595:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683602:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683611:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:3.0:1788526702.683614:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526702.683617:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526702.683623:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a5c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526702.683871:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+29:10306:x1875405868924416:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 2247us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526702.683883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1788526702.687076:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.687377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868924672 00000100:00100000:0.0:1788526702.687678:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868924672 00000100:00100000:1.0:1788526702.687858:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526702.687870:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+29:10306:x1875405868924672:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526702.688295:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+30:10306:x1875405868924672:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 426us (1232us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788526702.688304:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1788526702.737649:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526702.737819:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868924928 00000100:00100000:2.0:1788526702.737834:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868924928 00000100:00100000:2.0:1788526702.737918:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1788526702.737930:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+30:10309:x1875405868924928:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526702.737964:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526702.737989:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a5cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59445 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738088:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738106:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738138:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738156:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738164:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738171:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738312:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738321:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738340:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526702.738352:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788526702.738519:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738527:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738536:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738542:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526702.738553:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738563:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738576:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526702.738580:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526702.738585:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738592:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a5d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738610:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738616:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738621:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738627:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526702.738629:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738635:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738642:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c260d60300) 00010000:00010000:2.0:1788526702.738644:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526702.738653:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.738658:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3a5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.739587:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a5cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.739611:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526702.739621:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526702.739624:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526702.739627:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77e00, rc 0) 00000100:00100000:2.0:1788526702.740942:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+32:10309:x1875405868924928:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3003us (3300us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788526702.740955:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1788526702.744514:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526702.744936:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868925056 00000100:00100000:0.0:1788526702.744951:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868925056 00000100:00100000:0.0:1788526702.745035:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:0.0:1788526702.745047:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+32:10309:x1875405868925056:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1788526702.745838:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745862:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745877:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745910:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745918:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745927:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745933:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526702.745939:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745948:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745961:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526702.745964:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526702.745970:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526702.745990:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526702.746144:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+32:10309:x1875405868925056:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 1096us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526702.746154:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1788526702.748034:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526702.748134:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868925312 00000100:00100000:3.0:1788526702.748145:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868925312 00000100:00100000:3.0:1788526702.748209:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1788526702.748220:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+32:10309:x1875405868925312:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526702.748754:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+33:10309:x1875405868925312:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 533us (728us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788526702.748762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00010000:00010000:0.0:1788526702.803677:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526703.026545:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526703.026713:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868925568 00000100:00100000:1.0:1788526703.026727:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868925568 00000100:00100000:1.0:1788526703.026899:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1788526703.026911:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+33:10340:x1875405868925568:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1788526703.026945:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526703.026972:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a5f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5944c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.027107:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a5fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.027126:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.027139:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a5fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526703.027151:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788526703.027335:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a5f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5944c expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.027383:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a5fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5944c expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.027450:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:1.0:1788526703.027453:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526703.027457:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110400, rc 0) 00000100:00100000:1.0:1788526703.027541:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:10340:x1875405868925568:12345-192.168.204.59@tcp:101:cat.0 Request processed in 619us (998us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788526703.027549:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00080000:2.0:1788526703.028697:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526703.031847:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526703.031891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868925824 00000100:00100000:1.0:1788526703.031906:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868925824 00000100:00100000:1.0:1788526703.031988:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526703.032000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:10340:x1875405868925824:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1788526703.032543:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+36:10340:x1875405868925824:12345-192.168.204.59@tcp:35:cat.0 Request processed in 543us (720us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788526703.032554:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1788526703.033687:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526703.033761:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868925952 00000100:00100000:2.0:1788526703.033772:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868925952 00000100:00100000:2.0:1788526703.033846:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1788526703.033856:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+36:2349:x1875405868925952:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526703.033876:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526703.033907:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3a5fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5944c expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.033951:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526703.033958:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526703.034014:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+35:2349:x1875405868925952:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526703.034033:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1788526703.080663:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526703.081514:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868926208 00000100:00100000:1.0:1788526703.081530:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868926208 00000100:00100000:1.0:1788526703.081628:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1788526703.081642:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+35:10347:x1875405868926208:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1788526703.081680:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526703.081988:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788526703.082034:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59422 expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082085:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526703.082091:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526703.082108:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a60c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59453 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082368:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082448:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082459:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082499:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.082515:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 35 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.083334:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881545856:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526703.083651:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551600 going to sleep for 11 seconds 00000100:00100000:0.0:1788526703.088117:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea48a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881545856:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526703.088163:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.088242:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526703.088347:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868926336 00000100:00100000:2.0:1788526703.088358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868926336 00010000:00010000:2.0:1788526703.088503:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 36 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526703.088660:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1788526703.088691:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+36:2348:x1875405868926336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526703.088716:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526703.088725:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 36 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088741:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 36 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088774:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a5e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59445 expref: 36 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088800:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526703.088806:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088857:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088868:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.088901:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526703.088988:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:2348:x1875405868926336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 301us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526703.088997:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00010000:00010000:0.0:1788526703.089003:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.089011:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526703.089147:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788526703.089520:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a60c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.089611:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.089621:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526703.089623:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788526703.089634:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:0.0:1788526703.089741:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+35:10347:x1875405868926208:12345-192.168.204.59@tcp:101:dd.0 Request processed in 8101us (9095us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788526703.089750:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1788526703.094653:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.094756:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868926592 00000100:00100000:0.0:1788526703.094772:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868926592 00000100:00100000:0.0:1788526703.094863:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1788526703.094876:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+35:10347:x1875405868926592:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:0.0:1788526703.095294:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.095317:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.095343:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526703.095455:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788526703.095485:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d67a8115 reply state 00000000d16fbb0a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.095495:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526703.095630:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+38:10347:x1875405868926592:12345-192.168.204.59@tcp:36:dd.0 Request processed in 754us (991us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788526703.095640:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000020:00080000:0.0:1788526703.095646:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788526703.099731:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.099757:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.099766:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.099773:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526703.099780:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.099790:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.099814:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:3.0:1788526703.099818:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526703.100546:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.100557:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a621 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.361565:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.361683:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868926720 00000100:00100000:0.0:1788526703.361697:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868926720 00000100:00100000:0.0:1788526703.361768:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:0.0:1788526703.361779:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+37:10361:x1875405868926720:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:0.0:1788526703.361841:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526703.361870:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5945a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.361959:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.361978:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.361992:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362011:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362019:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362026:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362135:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362147:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362158:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362493:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.362519:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 38 pid: 5822 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.362539:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eceb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881545984:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526703.362693:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75300 going to sleep for 11 seconds 00000100:00100000:1.0:1788526703.366920:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526703.367086:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868926976 00000100:00100000:3.0:1788526703.367097:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868926976 00000100:00100000:3.0:1788526703.367175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526703.367187:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+39:5589:x1875405868926976:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788526703.367700:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+40:5589:x1875405868926976:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 514us (793us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788526703.367709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1788526703.368461:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eceb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881545984:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526703.368497:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.374264:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526703.374984:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868927104 00000100:00100000:2.0:1788526703.375000:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868927104 00010000:00010000:2.0:1788526703.375069:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 40 pid: 5822 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526703.375127:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1788526703.375138:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+40:2348:x1875405868927104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526703.375160:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526703.375169:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 40 pid: 5822 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375187:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 40 pid: 5822 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375217:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3a613 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59453 expref: 40 pid: 5822 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375265:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526703.375271:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375282:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375292:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.375349:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526703.376645:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+39:2348:x1875405868927104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1498us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526703.376660:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00010000:00010000:1.0:1788526703.376777:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.376804:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526703.376874:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788526703.376880:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526703.376947:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.376968:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.376982:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.376989:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.376998:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377005:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526703.377011:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377021:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377038:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526703.377042:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526703.377047:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377065:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a62f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377085:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377091:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377098:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377103:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526703.377106:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377114:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377121:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c243972200) 00010000:00010000:1.0:1788526703.377124:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526703.377127:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377133:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377188:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5945a expref: 39 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377204:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5945a expref: 38 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.377218:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:1.0:1788526703.377221:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526703.377224:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821800, rc 0) 00000100:00100000:1.0:1788526703.377273:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+38:10361:x1875405868926720:12345-192.168.204.59@tcp:101:stat.0 Request processed in 15496us (15725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526703.377282:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1788526703.478786:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.478964:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868927360 00000100:00100000:0.0:1788526703.478978:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868927360 00000100:00100000:0.0:1788526703.479059:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:0.0:1788526703.479072:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+38:10367:x1875405868927360:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:0.0:1788526703.479284:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526703.479334:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a63d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5945a expref: 38 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.479361:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526703.479369:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526703.479781:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.479800:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.479812:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526703.479896:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788526703.479920:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2e2b55a reply state 00000000164f8ff2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.479931:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526703.480360:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+40:10367:x1875405868927360:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 1289us (1595us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788526703.480370:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000020:00080000:0.0:1788526703.480377:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788526703.484379:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484442:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484452:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484459:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526703.484466:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484476:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484516:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526703.484519:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526703.484525:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.484532:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a644 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526703.703252:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526703.703959:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868927488 00000100:00100000:3.0:1788526703.703995:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868927488 00000100:00100000:3.0:1788526703.704074:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1788526703.704086:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+39:10381:x1875405868927488:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:3.0:1788526703.704112:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526703.704136:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a64b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59461 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704783:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704801:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704816:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704831:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704838:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.704862:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705139:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705324:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705336:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526703.705377:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788526703.705382:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526703.705609:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705624:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705632:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705640:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705646:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705653:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526703.705658:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705675:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705687:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526703.705690:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526703.705695:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705701:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a652 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705713:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705719:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705724:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705729:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526703.705731:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705736:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705742:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526703.705745:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526703.705747:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705762:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705798:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a64b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705811:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.705818:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:3.0:1788526703.705821:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526703.705823:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:3.0:1788526703.705907:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+40:10381:x1875405868927488:12345-192.168.204.59@tcp:101:stat.0 Request processed in 1823us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526703.705915:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:0.0:1788526703.822447:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526703.822928:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868927744 00000100:00100000:1.0:1788526703.823063:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868927744 00000100:00100000:1.0:1788526703.823150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1788526703.823162:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+40:10391:x1875405868927744:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526703.823195:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526703.823226:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3a667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59468 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526703.823365:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788526703.825913:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3a667 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59468 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.825944:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:1.0:1788526703.825949:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526703.825956:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3a667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59468 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.825980:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110000, rc 0) 00000100:00100000:1.0:1788526703.826078:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+41:10391:x1875405868927744:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2917us (3706us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788526703.826110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:2.0:1788526703.831226:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.831870:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928000 00000100:00100000:0.0:1788526703.831885:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928000 00000100:00100000:0.0:1788526703.831980:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1788526703.831994:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+41:10391:x1875405868928000:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1788526703.832329:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+42:10391:x1875405868928000:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 338us (1119us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788526703.832338:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:3.0:1788526703.836231:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526703.891869:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526703.898878:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928256 00000100:00100000:1.0:1788526703.899015:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928256 00000100:00100000:0.0:1788526703.900951:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:0.0:1788526703.900964:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+42:10397:x1875405868928256:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526703.901666:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526703.901691:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a675 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5946f expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.901804:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.901821:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.901843:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.901883:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.902382:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 43 pid: 5822 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.902689:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881546112:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526703.903211:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75840 going to sleep for 11 seconds 00000100:00100000:0.0:1788526703.925790:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526703.926682:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881546112:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526703.926713:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.926848:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928384 00000100:00100000:1.0:1788526703.926856:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928384 00010000:00010000:1.0:1788526703.927763:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 44 pid: 5822 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526703.927805:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1788526703.927818:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+44:2349:x1875405868928384:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526703.927854:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526703.927861:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 44 pid: 5822 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.927874:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 44 pid: 5822 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.930438:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a660 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59461 expref: 44 pid: 5822 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.930468:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:1.0:1788526703.930474:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.930485:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.930493:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.930564:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526703.930662:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+43:2349:x1875405868928384:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2846us (4881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526703.930673:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00010000:00010000:2.0:1788526703.930879:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.930888:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526703.930912:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788526703.931100:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a675 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 44 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.931115:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 43 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526703.931122:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:2.0:1788526703.931132:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788526703.931135:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821e00, rc 0) 00000100:00100000:2.0:1788526703.931163:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+43:10397:x1875405868928256:12345-192.168.204.59@tcp:101:bash.0 Request processed in 30203us (39308us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788526703.931170:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1788526703.935202:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.935326:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928640 00000100:00100000:0.0:1788526703.935339:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928640 00000100:00100000:0.0:1788526703.935462:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:0.0:1788526703.935477:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+43:10397:x1875405868928640:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1788526703.935851:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.935873:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.935886:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526703.935947:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788526703.935974:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e7b63d2 reply state 0000000090c2620a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.936009:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526703.936130:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+46:10397:x1875405868928640:12345-192.168.204.59@tcp:36:bash.0 Request processed in 657us (943us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788526703.936139:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000020:00080000:0.0:1788526703.936145:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788526703.942345:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.942506:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928768 00000100:00100000:0.0:1788526703.942526:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928768 00000100:00100000:0.0:1788526703.942622:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1788526703.942634:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:10397:x1875405868928768:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526703.942669:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526703.942697:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a691 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942811:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942830:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942840:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942848:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942873:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942909:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526703.942949:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.942977:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881546240:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526703.943147:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943157:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943164:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943170:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526703.943173:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943193:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943210:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:3.0:1788526703.943213:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526703.943216:0:3265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943226:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.943232:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a68a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526703.943523:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526703.951871:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526703.952096:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881546240:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526703.952139:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526703.952846:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868928896 00000100:00100000:3.0:1788526703.952857:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868928896 00010000:00010000:3.0:1788526703.952911:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526703.952966:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1788526703.952978:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+47:2348:x1875405868928896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526703.952997:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526703.953006:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953020:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953057:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a67c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5946f expref: 47 pid: 6721 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953091:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:3.0:1788526703.953097:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953108:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953118:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526703.953165:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526703.953241:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:2348:x1875405868928896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 264us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526703.953249:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00010000:00010000:1.0:1788526703.953524:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.953534:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526703.953596:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788526703.953603:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526703.953632:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.953671:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a691 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59476 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.953689:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59476 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526703.953697:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:1.0:1788526703.953700:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526703.953702:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820200, rc 0) 00000100:00100000:1.0:1788526703.953739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+45:10397:x1875405868928768:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11108us (11404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526703.953747:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1788526703.956727:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526703.956813:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868929152 00000100:00100000:3.0:1788526703.956828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868929152 00000100:00100000:3.0:1788526703.956931:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1788526703.956944:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+45:10397:x1875405868929152:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1788526703.957282:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:10397:x1875405868929152:12345-192.168.204.59@tcp:35:bash.0 Request processed in 339us (569us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788526703.957291:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1788526704.072224:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.072345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868929408 00000100:00100000:1.0:1788526704.072359:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868929408 00000100:00100000:0.0:1788526704.072630:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1788526704.072657:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+46:10407:x1875405868929408:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526704.072701:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526704.072729:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a69f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5947d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526704.072854:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788526704.073039:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a69f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5947d expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.073057:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526704.073061:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526704.073067:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a69f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5947d expref: 48 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.073085:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526704.073189:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+47:10407:x1875405868929408:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 548us (982us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788526704.073197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1788526704.078541:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.078852:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868929536 00000100:00100000:0.0:1788526704.078867:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868929536 00000100:00100000:0.0:1788526704.078966:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1788526704.078979:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+47:10407:x1875405868929536:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1788526704.079099:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079122:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079137:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079156:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079163:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079169:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079288:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079298:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079317:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526704.079422:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079439:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079447:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079455:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079462:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.079467:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079488:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079504:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526704.079508:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.079515:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079520:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079538:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079544:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079557:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079563:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.079566:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079572:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079580:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c243972a00) 00010000:00010000:0.0:1788526704.079583:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.079585:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079591:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079609:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079616:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079621:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079627:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.079630:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079663:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079671:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526704.079674:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.079684:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.079691:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526704.079796:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+47:10407:x1875405868929536:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 818us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.079807:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1788526704.084027:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881546752:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.084136:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.084225:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526704.084231:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881546368:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.084267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.084295:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881546880:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.084336:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.084365:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881546624:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.084426:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.084444:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788526704.084450:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881546496:0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.084660:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881546752 00000100:00100000:0.0:1788526704.084672:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881546752 00000100:00100000:0.0:1788526704.084757:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788526704.084769:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881546752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.084842:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881546752:12345-0@lo:400:kworker.0 Request processed in 75us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.084850:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788526704.084907:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eceb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881546752:0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.084942:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881546880 00000100:00100000:0.0:1788526704.084958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881546880 00000100:00100000:0.0:1788526704.084990:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881546624 00000100:00100000:0.0:1788526704.084993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881546624 00000100:00100000:0.0:1788526704.085014:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788526704.085021:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881546880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.085081:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881546880:12345-0@lo:400:kworker.0 Request processed in 60us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.085089:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788526704.085115:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881546880:0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.085133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788526704.085140:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881546624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.085172:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881546624:12345-0@lo:400:kworker.0 Request processed in 32us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.085178:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788526704.085351:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.085381:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881547008:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.085437:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526704.085468:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881546624:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.086171:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881546368 00000100:00100000:2.0:1788526704.086178:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881546368 00000100:00100000:2.0:1788526704.086216:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788526704.086224:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881546368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.086275:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881546368:12345-0@lo:400:kworker.0 Request processed in 52us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526704.086282:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788526704.086455:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881547008 00000100:00100000:2.0:1788526704.086461:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881547008 00000100:00100000:2.0:1788526704.086507:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788526704.086515:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881547008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526704.086820:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526704.086836:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526704.087339:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881546368:0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.087377:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881546496 00000100:00100000:0.0:1788526704.087383:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881546496 00000100:00100000:0.0:1788526704.087445:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788526704.087453:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881546496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526704.087522:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881546496:12345-0@lo:400:kworker.0 Request processed in 70us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.087530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788526704.095107:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881547008:12345-0@lo:400:kworker.0 Request processed in 8577us (9653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526704.095130:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788526704.095203:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526704.095211:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788526704.095216:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788526704.095285:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881546496:0@lo:400:kworker.0 00000100:00100000:2.0:1788526704.095317:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881547008:0@lo:400:kworker.0 00000100:00100000:3.0:1788526704.096144:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.099971:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526704.100077:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868929792 00000100:00100000:1.0:1788526704.100090:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868929792 00000100:00100000:1.0:1788526704.100179:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1788526704.100192:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+47:10407:x1875405868929792:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526704.100552:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+48:10407:x1875405868929792:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 362us (4413us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788526704.100561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1788526704.101367:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881547136 00000100:00100000:3.0:1788526704.101379:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881547136 00000100:00100000:3.0:1788526704.101443:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788526704.101452:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881547136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526704.101507:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526704.101608:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881547136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526704.101615:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788526704.102365:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526704.190964:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.191145:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930048 00000100:00100000:0.0:1788526704.191160:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930048 00000100:00100000:0.0:1788526704.191253:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:0.0:1788526704.191265:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+48:10410:x1875405868930048:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526704.191312:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526704.191340:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59484 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191520:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191538:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191551:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191567:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191575:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191582:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191880:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191892:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.191899:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526704.191911:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788526704.192328:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192339:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192360:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192366:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.192371:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192380:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192420:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526704.192424:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.192429:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192436:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3a6c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192452:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192459:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.192465:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.194999:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.195010:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195064:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195086:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c243972a00) 00010000:00010000:0.0:1788526704.195089:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.195095:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195102:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195214:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59484 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195232:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59484 expref: 50 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.195240:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526704.195243:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526704.195246:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526704.195793:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+50:10410:x1875405868930048:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 4525us (4844us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788526704.195805:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1788526704.212928:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526704.212989:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.213156:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930176 00000100:00100000:1.0:1788526704.213170:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930176 00000100:00100000:1.0:1788526704.213261:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1788526704.213274:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:10410:x1875405868930176:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1788526704.213438:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213461:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213555:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213596:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213631:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213639:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213646:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526704.213652:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.213661:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526704.213779:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930304 00000100:00100000:0.0:1788526704.213785:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930304 00000100:00100000:0.0:1788526704.213828:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1788526704.213837:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:2351:x1875405868930304:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526704.213859:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526704.213879:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59484 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.213898:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526704.213904:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526704.213977:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:2351:x1875405868930304:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 140us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.213985:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00010000:00010000:1.0:1788526704.214031:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:1.0:1788526704.214035:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526704.214040:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.214047:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a6e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526704.214089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+49:10410:x1875405868930176:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 818us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526704.214097:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1788526704.225132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.225447:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930560 00000100:00100000:1.0:1788526704.225464:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930560 00000100:00100000:1.0:1788526704.225564:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1788526704.225578:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+49:10410:x1875405868930560:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526704.226372:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:10410:x1875405868930560:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 793us (1253us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788526704.226449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1788526704.494248:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.494438:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930816 00000100:00100000:0.0:1788526704.494453:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930816 00000100:00100000:0.0:1788526704.494596:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:0.0:1788526704.494611:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+50:10428:x1875405868930816:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:0.0:1788526704.494661:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526704.494697:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5948b expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.494875:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.494895:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.494909:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526704.494922:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788526704.495128:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a6ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5948b expref: 53 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.495154:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5948b expref: 52 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.495166:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526704.495169:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788526704.495173:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821a00, rc 0) 00000100:00100000:0.0:1788526704.495267:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+52:10428:x1875405868930816:12345-192.168.204.59@tcp:101:cat.0 Request processed in 659us (1036us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788526704.495276:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1788526704.544140:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.544267:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868930944 00000100:00100000:1.0:1788526704.544283:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868930944 00000100:00100000:1.0:1788526704.544381:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:1.0:1788526704.544467:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+52:10429:x1875405868930944:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526704.544505:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526704.544533:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a701 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59492 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.544647:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.544668:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.544683:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526704.544733:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788526704.544738:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526704.544763:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.546772:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a701 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59492 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.547019:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59492 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.547062:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526704.547066:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526704.547071:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110800, rc 0) 00000100:00100000:1.0:1788526704.547175:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+53:10429:x1875405868930944:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2710us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526704.547186:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1788526704.555483:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526704.555643:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931328 00000100:00100000:3.0:1788526704.555657:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931328 00000100:00100000:3.0:1788526704.555736:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1788526704.555747:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+53:10429:x1875405868931328:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526704.556360:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+54:10429:x1875405868931328:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 612us (894us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788526704.556369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1788526704.559462:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.559549:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931456 00000100:00100000:0.0:1788526704.559561:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931456 00000100:00100000:0.0:1788526704.559651:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1788526704.559663:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:10429:x1875405868931456:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:0.0:1788526704.559693:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788526704.559727:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59476 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.559755:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a6f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5948b expref: 53 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.559770:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a5a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59437 expref: 52 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.559782:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60500) 00010000:00010000:0.0:1788526704.559826:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526704.559909:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+51:10429:x1875405868931456:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 248us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.559917:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1788526704.563086:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.563332:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931584 00000100:00100000:0.0:1788526704.563347:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931584 00000100:00100000:0.0:1788526704.563469:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1788526704.563481:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+51:10429:x1875405868931584:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:0.0:1788526704.564046:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.564069:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.564084:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526704.564535:0:6721:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526704.566131:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788526704.566254:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788526704.566841:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+51:10429:x1875405868931584:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 3353us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.566857:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:1.0:1788526704.596659:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526704.597323:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931712 00000100:00100000:2.0:1788526704.597357:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931712 00000100:00100000:2.0:1788526704.597492:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1788526704.597505:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+51:10431:x1875405868931712:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526704.597534:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526704.597564:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a716 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59499 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597662:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597688:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597702:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597721:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597728:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597734:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597848:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597858:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597878:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526704.597929:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788526704.597934:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526704.597956:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597971:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597980:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597987:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.597995:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598001:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526704.598007:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598016:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598030:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526704.598033:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526704.598039:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a71d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598073:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598079:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598085:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598090:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526704.598093:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598099:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598107:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c260d60300) 00010000:00010000:2.0:1788526704.598110:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526704.598113:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598119:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3a724 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598156:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3a716 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598171:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.598190:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:2.0:1788526704.598192:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526704.598196:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77400, rc 0) 00000100:00100000:2.0:1788526704.598304:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:10431:x1875405868931712:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 793us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526704.598312:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00010000:00010000:3.0:1788526704.851650:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788526704.851982:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788526704.851989:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788526704.852050:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788526704.852059:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788526704.852218:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb71c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881547264:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788526704.852367:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247d84600 going to sleep for 11 seconds 00000100:00100000:2.0:1788526704.858034:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526704.860986:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb71c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881547264:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788526704.866571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931840 00000100:00100000:0.0:1788526704.866595:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931840 00000100:00100000:0.0:1788526704.866697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526704.866711:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868931840:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788526704.866844:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868931840:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 135us (8826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.866866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1788526704.872158:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526704.872264:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868931968 00000100:00100000:3.0:1788526704.872279:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868931968 00000100:00100000:3.0:1788526704.872376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1788526704.872425:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868931968:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788526704.872476:0:5824:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788526704.872642:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868931968:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 220us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526704.872658:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1788526704.880584:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.880925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868932096 00000100:00100000:0.0:1788526704.880939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868932096 00000100:00100000:0.0:1788526704.881018:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:0.0:1788526704.881031:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868932096:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788526704.881142:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881165:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881180:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881200:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881208:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881215:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881249:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881259:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881264:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526704.881336:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788526704.881341:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526704.881361:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881376:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881384:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881418:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881425:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.881430:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881438:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881452:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:0.0:1788526704.881465:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.881472:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881478:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a732 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881489:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881507:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881514:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881519:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.881522:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881529:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881536:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98c243972200) 00010000:00010000:0.0:1788526704.881539:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.881542:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881548:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a739 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881565:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881572:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881578:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881583:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.881593:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881600:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881609:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:0.0:1788526704.881612:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526704.881615:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.881621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a740 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526704.881742:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868932096:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 711us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.881751:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1788526704.900030:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.900156:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868932352 00000100:00100000:0.0:1788526704.900171:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868932352 00000100:00100000:0.0:1788526704.900242:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:0.0:1788526704.900254:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+52:10442:x1875405868932352:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526704.900284:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526704.900331:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a747 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594a0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900501:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900521:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900555:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526704.900569:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788526704.900719:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900727:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900735:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900742:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526704.900747:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900756:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900772:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:0.0:1788526704.900775:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526704.900781:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900787:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3a74e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900840:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a747 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594a0 expref: 54 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900862:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:0.0:1788526704.900865:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526704.900870:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a747 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594a0 expref: 54 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.900880:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526704.900955:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868932352:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 703us (942us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788526704.900964:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:3.0:1788526704.917577:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526704.917651:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868932480 00000100:00100000:0.0:1788526704.917678:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868932480 00000100:00100000:0.0:1788526704.917755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1788526704.917768:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868932480:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788526704.917819:0:5823:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788526704.917984:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868932480:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 216us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.917994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1788526704.926546:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526704.926730:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868932736 00000100:00100000:2.0:1788526704.926748:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868932736 00000100:00100000:2.0:1788526704.926847:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:2.0:1788526704.926861:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868932736:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526704.926892:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526704.926898:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788526704.926934:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3a708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59492 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.926960:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526704.926965:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526704.926983:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a75c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594a7 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526704.932761:0:6721:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788526704.933128:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.933159:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.933177:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.933273:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a75c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594a7 expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.933310:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594a7 expref: 54 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.933320:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60300) 00010000:00010000:2.0:1788526704.933323:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526704.933327:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77600, rc 0) 00000100:00100000:2.0:1788526704.933453:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+54:10442:x1875405868932736:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 6595us (6926us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788526704.933464:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1788526704.941887:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526704.942061:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868932992 00000100:00100000:1.0:1788526704.942076:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868932992 00000100:00100000:1.0:1788526704.942150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:1.0:1788526704.942162:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:10442:x1875405868932992:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526704.942254:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526704.942303:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3a763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594a7 expref: 54 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.942328:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60300) 00010000:00010000:1.0:1788526704.942343:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526704.942377:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.942426:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.942440:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946336:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946478:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946567:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946576:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946583:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946589:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526704.946594:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946602:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946616:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526704.946620:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526704.946625:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946632:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3a771 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.946646:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947196:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947205:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947210:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526704.947214:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947221:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947231:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xefe99193 (ffff98c272284400) 00010000:00010000:1.0:1788526704.947234:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526704.947237:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.947243:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111a00/0x367645d450b3a778 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xefe99193 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526704.947950:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868932992:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 5783us (6074us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526704.947961:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:3.0:1788526704.957800:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526704.957884:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868933120 00000100:00100000:2.0:1788526704.957905:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868933120 00000100:00100000:2.0:1788526704.958002:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:2.0:1788526704.958015:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+53:10442:x1875405868933120:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526704.958044:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526704.958077:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a77f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594ae expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958129:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958170:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958185:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958315:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a77f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958337:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.958347:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:2.0:1788526704.958351:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788526704.958355:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77c00, rc 0) 00000100:00100000:2.0:1788526704.958747:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:10442:x1875405868933120:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 730us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526704.958755:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:2.0:1788526704.977269:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526704.977334:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868933376 00000100:00100000:2.0:1788526704.977347:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868933376 00000100:00100000:2.0:1788526704.977435:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:2.0:1788526704.977450:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+54:10442:x1875405868933376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788526704.977572:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.977595:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526704.977623:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526704.978034:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788526704.978050:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340318663017ns, next at 341318659233ns, rc = 0 00000004:00010000:2.0:1788526704.978181:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f7c5695 reply state 00000000983b18dc transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526704.978194:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526704.978337:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:10442:x1875405868933376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 888us (1082us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788526704.978348:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:3.0:1788526704.992544:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1788526704.992582:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992603:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992637:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992645:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526704.992652:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992674:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992700:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:1.0:1788526704.992704:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526704.992709:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526704.992717:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a78d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526704.993868:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868933504 00000100:00100000:0.0:1788526704.993889:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868933504 00000100:00100000:0.0:1788526704.993980:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1788526704.993994:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+55:10442:x1875405868933504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526704.994032:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526704.994061:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594b5 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.994176:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 56 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.994194:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 56 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526704.994218:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:0.0:1788526704.994222:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788526704.994225:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526704.995169:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+56:10442:x1875405868933504:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1171us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526704.995181:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1788526705.024046:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.024488:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868933632 00000100:00100000:1.0:1788526705.024504:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868933632 00000100:00100000:1.0:1788526705.024561:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1788526705.024571:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1875405868933632:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788526705.024618:0:6671:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1788526705.024675:0:6671:0:(genops.c:1385:class_connect()) connect: client f122900d-e71c-4fc3-b559-b19040da7c34, cookie 0x367645d450b3a79b 00002000:00100000:1.0:1788526705.024693:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f122900d-e71c-4fc3-b559-b19040da7c34/ffff98c274ba5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788526705.024708:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788526705.030253:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788526705.030344:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c242c2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526705.030514:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2347:x1875405868933632:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 Request processed in 5939us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526705.030532:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1788526705.047605:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.047892:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868933760 00000100:00100000:1.0:1788526705.047907:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868933760 00000100:00100000:1.0:1788526705.048008:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1788526705.048020:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:0:x1875405868933760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788526705.049014:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788526705.107665:0:6720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340448273927ns, next at 341448271103ns, rc = 0 00000100:00100000:2.0:1788526705.107982:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881547392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526705.108086:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526705.108341:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881547392 00000100:00100000:1.0:1788526705.108356:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881547392 00000100:00100000:1.0:1788526705.108759:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788526705.108773:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881547392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526705.109037:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526705.109179:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881547392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 408us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526705.109189:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788526705.109980:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881547392:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788526705.116799:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788526705.116822:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000100:00100000:1.0:1788526705.117355:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:0:x1875405868933760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 69328us (69758us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788526705.117368:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1788526705.127529:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.127671:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934016 00000100:00100000:2.0:1788526705.127685:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934016 00000100:00100000:2.0:1788526705.127789:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526705.127802:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:10442:x1875405868934016:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788526705.128147:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:10442:x1875405868934016:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 347us (638us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788526705.128157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00080000:3.0:1788526705.128740:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526705.133204:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.133446:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934272 00000100:00100000:2.0:1788526705.133460:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934272 00000100:00100000:2.0:1788526705.133557:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:2.0:1788526705.133569:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:10442:x1875405868934272:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788526705.133735:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:10442:x1875405868934272:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 167us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.133744:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:2.0:1788526705.137087:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526705.138188:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934400 00000100:00100000:0.0:1788526705.138207:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934400 00000100:00100000:0.0:1788526705.138314:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:0.0:1788526705.138327:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+57:10442:x1875405868934400:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526705.138361:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526705.138539:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a7a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594bc expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138665:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138694:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138708:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526705.138758:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526705.138782:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138814:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3a7a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594bc expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138840:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594bc expref: 58 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.138850:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:0.0:1788526705.138854:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788526705.138859:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821200, rc 0) 00000100:00100000:0.0:1788526705.139074:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+58:10442:x1875405868934400:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 748us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526705.139083:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:0.0:1788526705.148365:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526705.148453:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934528 00000100:00100000:0.0:1788526705.148470:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934528 00000100:00100000:0.0:1788526705.148556:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1788526705.148569:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868934528:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526705.148596:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526705.148627:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594c3 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526705.148664:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac070, blocks: 0x1 00010000:00010000:0.0:1788526705.148690:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788526705.148696:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526705.148708:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.148737:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.148755:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820e00, rc 0) 00000100:00100000:0.0:1788526705.148845:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868934528:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 278us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526705.148853:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1788526705.160759:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.161941:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934784 00000100:00100000:2.0:1788526705.161958:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934784 00000100:00100000:2.0:1788526705.162032:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1788526705.162043:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:10442:x1875405868934784:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788526705.162196:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:10442:x1875405868934784:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 154us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.162205:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:3.0:1788526705.167659:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526705.167712:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868934912 00000100:00100000:3.0:1788526705.167725:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868934912 00000100:00100000:3.0:1788526705.167803:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1788526705.167815:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:10442:x1875405868934912:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526705.167839:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526705.167859:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594ca expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.167896:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.167907:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526705.167913:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526705.167919:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.167983:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.168000:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 7 pid: 6669 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526705.168016:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8450:1875405881547520:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526705.168111:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526705.181065:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.181225:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935040 00000100:00100000:1.0:1788526705.181238:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935040 00010000:00010000:1.0:1788526705.181304:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 8 pid: 6669 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.181362:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1788526705.181373:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868935040:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526705.181423:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526705.181462:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 8 pid: 6669 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.181479:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 8 pid: 6669 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.181520:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526705.181525:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526705.181536:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.181547:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.181597:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.181614:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875405881547648:192.168.204.59@tcp:105: 00000100:00100000:1.0:1788526705.181720:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2451cb300 going to sleep for 11 seconds 00010000:00010000:0.0:1788526705.181852:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057179153/0x367645d450b3a7b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594c3 expref: 8 pid: 6669 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526705.181868:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8450:1875405881547520:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526705.181903:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.181943:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:0.0:1788526705.181984:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:10442:x1875405868934912:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 14171us (14338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526705.181994:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1788526705.199504:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.199704:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875405881547648:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526705.199737:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526705.199816:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868935040:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 18443us (18765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526705.199829:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1788526705.200226:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935168 00000100:00100000:3.0:1788526705.200236:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935168 00002000:00100000:3.0:1788526705.200311:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98c274952d80 x1875405868935168/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:421/0 lens 504/0 e 0 to 0 dl 1788526716 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526705.200323:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274952d80 with x1875405868935168 ext(0->8) 00002000:00010000:3.0:1788526705.200329:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c274952d80 00000100:00100000:3.0:1788526705.200375:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526705.200412:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868935168:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788526705.201430:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868935168:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 1039us (1938us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788526705.201441:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:3.0:1788526705.201450:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98c274952d80 x1875405868935168/t4294967302(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:421/0 lens 504/448 e 0 to 0 dl 1788526716 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526705.201462:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274952d80 with x1875405868935168 ext(0->8) 00002000:00010000:3.0:1788526705.201477:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c274952d80 00000100:00100000:2.0:1788526705.213009:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526705.213101:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935296 00000100:00100000:3.0:1788526705.213115:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935296 00000100:00100000:3.0:1788526705.213195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:3.0:1788526705.213207:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+58:10442:x1875405868935296:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788526705.287573:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+58:10442:x1875405868935296:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 74351us (74562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526705.287593:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000004:00080000:3.0:1788526705.287647:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788526705.288546:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:3.0:1788526705.288622:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788526705.288633:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1788526705.288654:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788526705.288682:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c27b77e540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788526705.288687:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27b9def00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c27b77e180 00000020:00080000:3.0:1788526705.288690:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c27b9dea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c245086000 00000020:00080000:1.0:1788526705.289445:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788526705.289624:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788526705.289745:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881547776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788526705.290070:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526705.290158:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526705.290168:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881547904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788526705.290201:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526705.296034:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526705.298019:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881547776 00000100:00100000:3.0:1788526705.298045:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881547776 00000100:00100000:3.0:1788526705.298129:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881547904 00000100:00100000:3.0:1788526705.298133:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881547904 00000100:00100000:3.0:1788526705.298148:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935424 00000100:00100000:3.0:1788526705.298151:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935424 00000100:00100000:3.0:1788526705.298194:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788526705.298205:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875405881547776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788526705.298257:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788526705.298327:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ac06d, atime: 0x6a9ac06d, ctime: 0x6a9ac06d, blocks: 0xb 00010000:00010000:3.0:1788526705.298340:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.298363:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1788526705.298369:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526705.298378:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.298424:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.298439:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.298448:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.298473:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788526705.299204:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3279:x1875405881547776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 997us (9132us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788526705.299213:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788526705.299245:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526705.299255:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881547904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788526705.306771:0:6670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00000100:00100000:2.0:1788526705.306945:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.306999:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.307029:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935808 00000100:00100000:2.0:1788526705.307041:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935808 00000100:00100000:2.0:1788526705.307126:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:2.0:1788526705.307140:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868935808:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526705.307235:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868935808:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 99us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.307243:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00080000:2.0:1788526705.307270:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526705.307420:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00002000:00010000:3.0:1788526705.307535:0:6670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788526704 00002000:00010000:3.0:1788526705.307538:0:6670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788526705.307540:0:6670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788526704 -> 1788526704 00002000:00010000:3.0:1788526705.307542:0:6670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788526705.307609:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881547904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8355us (17405us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788526705.307618:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526705.307647:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935680 00000100:00100000:3.0:1788526705.307651:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935680 00000100:00100000:3.0:1788526705.307680:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:3.0:1788526705.307688:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868935680:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526705.307720:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868935680:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526705.307727:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:3.0:1788526705.307741:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1788526705.307749:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868935424:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788526705.307913:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c1422c7480/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788526705.307922:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881547904:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788526705.307944:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526705.308133:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868935552 00000100:00100000:0.0:1788526705.308139:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868935552 00000100:00100000:0.0:1788526705.308176:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 314 00000100:00100000:0.0:1788526705.308184:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868935552:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526705.308224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868935552:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526705.308231:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 314 00010000:00010000:3.0:1788526705.309044:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526705.309059:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.309076:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526705.309082:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.309120:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.309150:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.309159:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a7be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.309182:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526705.309185:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526705.309187:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788526705.309232:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c26f9d8a80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788526705.309239:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881547776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788526705.461007:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868935424:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 153239us (164972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526705.461026:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000001:00080000:0.0:1788526705.461693:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788526705.461707:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788526705.481908:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526705.481984:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936064 00000100:00100000:3.0:1788526705.482000:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936064 00000100:00100000:3.0:1788526705.482077:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1788526705.482090:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:10442:x1875405868936064:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788526705.482178:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526705.482219:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594bc expref: 13 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.482262:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526705.482268:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526705.482334:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.482352:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.482364:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526705.482723:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ca2c04 reply state 000000006e7666a9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526705.482736:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788526705.483570:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:10442:x1875405868936064:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1475us (1673us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788526705.483582:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00010000:00010000:0.0:1788526705.486800:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486826:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486836:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486843:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526705.486850:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486859:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486901:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:0.0:1788526705.486904:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526705.486911:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.486919:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a7c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.501906:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526705.502050:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936192 00000100:00100000:0.0:1788526705.502064:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936192 00000100:00100000:0.0:1788526705.502148:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:0.0:1788526705.502162:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868936192:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788526705.502583:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788526705.502588:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788526704 -> 1788526703 00002000:00010000:0.0:1788526705.502591:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788526701 00002000:00010000:0.0:1788526705.502594:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788526704 -> 1788526703 00002000:00010000:0.0:1788526705.502597:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788526705.502685:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868936192:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 525us (794us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788526705.502694:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1788526705.506053:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.506150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936448 00000100:00100000:2.0:1788526705.506165:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936448 00000100:00100000:2.0:1788526705.506247:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1788526705.506260:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:10442:x1875405868936448:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788526705.506373:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.506445:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.506458:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.506506:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.506523:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 13 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526705.506541:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274951180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881548032:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526705.506661:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248327cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526705.510545:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274951180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881548032:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526705.510590:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526705.511229:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.511711:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936576 00000100:00100000:2.0:1788526705.511724:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936576 00010000:00010000:2.0:1788526705.511796:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 14 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526705.511841:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:2.0:1788526705.511852:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+14:2349:x1875405868936576:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526705.511874:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526705.511883:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 14 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.511899:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 14 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.511942:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3a786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ae expref: 14 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.511962:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:2.0:1788526705.511968:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.511982:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.511993:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.512238:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526705.512346:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868936576:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 494us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.512356:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:0.0:1788526705.516702:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.516727:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.518900:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519095:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519106:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519113:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526705.519120:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519130:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519170:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:2.0:1788526705.519174:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788526705.519180:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.519187:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3a7cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526705.519356:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+12:10442:x1875405868936448:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 13086us (13307us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788526705.519370:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1788526705.522568:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526705.522690:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936704 00000100:00100000:0.0:1788526705.522704:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936704 00000100:00100000:0.0:1788526705.522800:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1788526705.522813:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868936704:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788526705.522876:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.522908:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.522919:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526705.522925:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526705.522931:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.522989:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.523006:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 7 pid: 8450 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526705.523024:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8450:1875405881548160:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526705.523130:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526705.529098:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8450:1875405881548160:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526705.529150:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526705.529739:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.530449:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868936832 00000100:00100000:1.0:1788526705.530463:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868936832 00010000:00010000:1.0:1788526705.530528:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.530586:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1788526705.530598:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868936832:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526705.530621:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526705.530652:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.530670:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.530701:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008430c373/0x367645d450b3a7b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ca expref: 8 pid: 8450 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.530725:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526705.530730:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526705.530736:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.530763:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.530795:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526705.530871:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868936832:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 275us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526705.530879:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00010000:00010000:0.0:1788526705.532147:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532168:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532237:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532246:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532256:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532264:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526705.532270:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532296:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532317:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526705.532325:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6271799/0x367645d450b3a7d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526705.532498:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868936704:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 9682us (9938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526705.532509:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1788526705.549697:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.549844:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937088 00000100:00100000:1.0:1788526705.549862:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937088 00000100:00100000:1.0:1788526705.549962:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:1.0:1788526705.549975:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+12:10442:x1875405868937088:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788526705.550098:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550122:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550147:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550515:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550528:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 13 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550538:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550608:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 13 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.550625:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 13 pid: 6721 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.550643:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881548288:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526705.550748:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247d84f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526705.558354:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526705.558488:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937216 00000100:00100000:2.0:1788526705.558518:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937216 00010000:00010000:2.0:1788526705.558579:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 14 pid: 6721 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526705.558636:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1788526705.558647:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+14:2348:x1875405868937216:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526705.558669:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526705.558678:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 14 pid: 6721 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.558696:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 14 pid: 6721 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.558731:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:2.0:1788526705.558738:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.558751:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.558761:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.558787:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526705.558856:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+14:2348:x1875405868937216:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 211us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.558864:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00010000:00010000:3.0:1788526705.559615:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594b5 expref: 13 pid: 6721 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526705.559638:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881548288:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526705.559671:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.559697:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.559706:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526705.559990:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788526705.560176:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788526705.560228:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788526705.560370:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881548416:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788526705.560861:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526705.560914:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526705.561448:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881548416 00000100:00100000:2.0:1788526705.561458:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881548416 00000100:00100000:2.0:1788526705.561528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526705.561539:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881548416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788526705.561681:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881548416:12345-0@lo:1000:mdt00_002.0 Request processed in 145us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526705.561690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526705.561862:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788526705.561870:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c1422c7480, transno 4294967303 00000100:00100000:1.0:1788526705.561896:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881548416:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788526705.562790:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788526705.562897:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881548544:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788526705.563078:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526705.563116:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247d84600 going to sleep for 11 seconds 00000100:00100000:2.0:1788526705.563595:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881548544 00000100:00100000:2.0:1788526705.563606:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881548544 00000100:00100000:2.0:1788526705.563648:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526705.563656:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881548544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788526705.563868:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875405881548544:12345-0@lo:1000:mdt00_002.0 Request processed in 212us (790us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788526705.563877:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526705.564213:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea4b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881548544:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788526705.564265:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564289:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564299:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564307:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526705.564323:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564334:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564355:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:1.0:1788526705.564359:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526705.564365:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564374:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a7e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564627:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564636:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564643:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564649:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526705.564653:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564661:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564670:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:1.0:1788526705.564674:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526705.564697:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564705:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a70f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564765:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564784:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564797:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564842:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.564859:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 16 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526705.564874:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881548672:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526705.565084:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247d84600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526705.572441:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881548672:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526705.572492:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526705.575930:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526705.576019:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937344 00000100:00100000:3.0:1788526705.576033:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937344 00010000:00010000:3.0:1788526705.576089:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 17 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526705.576152:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1788526705.576165:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+17:2349:x1875405868937344:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526705.576184:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526705.576193:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 17 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576229:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 17 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576260:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3a72b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59499 expref: 17 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576293:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:3.0:1788526705.576301:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576313:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576324:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526705.576369:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526705.576564:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576574:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576591:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576610:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576618:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576626:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526705.576632:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576642:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576653:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:1.0:1788526705.576656:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526705.576660:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576666:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3a7e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576678:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576684:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576691:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576696:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526705.576706:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576713:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576722:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c243972a00) 00010000:00010000:1.0:1788526705.576725:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526705.576728:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.576734:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a7da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526705.577269:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526705.577287:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526705.577321:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788526705.577327:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526705.577599:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:10442:x1875405868937088:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 27622us (27915us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788526705.577611:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000020:00080000:1.0:1788526705.577617:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788526705.577846:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:2349:x1875405868937344:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1683us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526705.577855:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1788526705.582047:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526705.582171:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937600 00000100:00100000:1.0:1788526705.582188:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937600 00000100:00100000:1.0:1788526705.582269:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1788526705.582295:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+15:10442:x1875405868937600:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788526705.583241:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788526705.583414:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788526705.583474:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583510:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583525:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583538:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583546:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583554:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526705.583574:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788526705.583705:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+17:10442:x1875405868937600:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1409us (1670us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788526705.583715:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000020:00080000:1.0:1788526705.583722:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788526705.585263:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526705.585290:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.585303:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526705.585308:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.585321:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.585344:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98c272284600) 00010000:00010000:2.0:1788526705.585348:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788526705.585354:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.585374:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3a7ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526705.585443:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526705.585445:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526705.585448:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526705.844948:0:11995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526705.844961:0:11995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526705.845005:0:11995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788526705.845012:0:11995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788526705.878442:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526706.021645:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.021717:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937856 00000100:00100000:0.0:1788526706.021732:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937856 00000100:00100000:0.0:1788526706.021826:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1788526706.021839:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+17:10452:x1875405868937856:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526706.021878:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.021908:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594d1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.022046:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a7fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.022067:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a7fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.022082:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a7fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526706.022096:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788526706.022280:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d1 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.022305:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a7fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d1 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.022316:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526706.022319:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788526706.022324:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820c00, rc 0) 00000100:00100000:0.0:1788526706.022430:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:10452:x1875405868937856:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 593us (803us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788526706.022449:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:1.0:1788526706.036378:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.036445:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868937984 00000100:00100000:3.0:1788526706.036459:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868937984 00000100:00100000:3.0:1788526706.036535:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1788526706.036548:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+19:10452:x1875405868937984:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1788526706.036660:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.036698:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.036713:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.036732:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.036740:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.036746:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037066:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037076:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037083:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526706.037133:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037149:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037157:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037175:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037182:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.037187:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037196:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037210:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526706.037213:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.037218:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037224:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a80b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037236:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037242:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037248:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037253:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.037255:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037282:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037291:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b900) 00010000:00010000:3.0:1788526706.037293:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.037296:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037302:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037316:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037321:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037326:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037332:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.037335:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037341:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037347:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c242a8b500) 00010000:00010000:3.0:1788526706.037349:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.037351:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.037364:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.037481:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+19:10452:x1875405868937984:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 933us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526706.037490:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1788526706.079419:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.088166:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868938240 00000100:00100000:2.0:1788526706.088188:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868938240 00000100:00100000:2.0:1788526706.088308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:2.0:1788526706.088321:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:10455:x1875405868938240:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526706.088350:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526706.088378:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594d8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088504:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088524:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088538:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088555:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088563:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088570:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.088994:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089004:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089010:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526706.089022:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788526706.089154:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089162:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089169:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089176:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.089181:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089191:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089206:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526706.089209:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526706.089216:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089234:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a827 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089247:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089253:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089260:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089277:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.089281:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089287:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089295:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c260d60200) 00010000:00010000:2.0:1788526706.089298:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526706.089301:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089307:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a82e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089362:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089379:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.089421:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526706.089423:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526706.089426:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77000, rc 0) 00000100:00100000:2.0:1788526706.089523:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+21:10455:x1875405868938240:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1204us (10144us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788526706.089532:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1788526706.094853:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.095008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868938368 00000100:00100000:2.0:1788526706.095022:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868938368 00000100:00100000:2.0:1788526706.095100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:2.0:1788526706.095114:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+21:10455:x1875405868938368:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1788526706.095219:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095240:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095256:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095305:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095314:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095323:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095329:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.095347:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095356:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095371:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526706.095375:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526706.095381:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.095414:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526706.095518:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+21:10455:x1875405868938368:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 407us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526706.095527:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:3.0:1788526706.096963:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.097090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868938624 00000100:00100000:2.0:1788526706.097100:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868938624 00000100:00100000:2.0:1788526706.097153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1788526706.097162:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:10455:x1875405868938624:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526706.097517:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+22:10455:x1875405868938624:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 354us (561us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788526706.097524:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1788526706.154176:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.154224:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868938880 00000100:00100000:3.0:1788526706.154239:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868938880 00000100:00100000:3.0:1788526706.154320:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1788526706.154331:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:9983:x1875405868938880:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526706.154375:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526706.154422:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a84a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.154565:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.154586:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.154598:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.154642:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.154668:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 23 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.154687:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881548800:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526706.154801:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526706.156975:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.157336:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881548800:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526706.157380:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.158179:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939008 00000100:00100000:1.0:1788526706.158189:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939008 00010000:00010000:1.0:1788526706.158238:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 24 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.158310:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1788526706.158321:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+24:2349:x1875405868939008:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526706.158341:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526706.158349:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 24 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158363:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 24 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158420:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3a835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d8 expref: 24 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158436:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:1.0:1788526706.158442:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158453:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158461:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.158484:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526706.158509:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.158516:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526706.158539:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:1.0:1788526706.158554:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+23:2349:x1875405868939008:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 234us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526706.158562:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00010000:00010000:0.0:1788526706.158730:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a84a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.158747:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.158755:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:0.0:1788526706.158758:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788526706.158761:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55a00, rc 0) 00000100:00100000:0.0:1788526706.158877:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+23:9983:x1875405868938880:12345-192.168.204.59@tcp:101:bash.0 Request processed in 4546us (4715us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788526706.158885:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:0.0:1788526706.165618:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.165720:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939264 00000100:00100000:1.0:1788526706.165752:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939264 00000100:00100000:1.0:1788526706.165901:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1788526706.165915:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+23:9983:x1875405868939264:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:1.0:1788526706.166304:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.166327:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.166341:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526706.166619:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788526706.166647:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009abf3272 reply state 0000000044b34108 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.166657:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788526706.166709:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788526706.168645:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+27:9983:x1875405868939264:12345-192.168.204.59@tcp:36:bash.0 Request processed in 2717us (3024us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788526706.168658:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000020:00080000:1.0:1788526706.168665:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788526706.172825:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.172848:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.172873:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.172881:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.172888:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.172898:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.173022:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:2.0:1788526706.173084:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526706.173089:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526706.173095:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.173103:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3a85f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.173535:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939392 00000100:00100000:0.0:1788526706.173551:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939392 00000100:00100000:0.0:1788526706.173628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1788526706.173651:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+26:9983:x1875405868939392:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526706.173684:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.173710:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a866 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594e6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.173800:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594e6 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.173816:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a866 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594e6 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.173838:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:0.0:1788526706.173841:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788526706.173844:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821200, rc 0) 00000100:00100000:0.0:1788526706.173924:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+27:9983:x1875405868939392:12345-192.168.204.59@tcp:101:bash.0 Request processed in 275us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526706.173932:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1788526706.177441:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.177625:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939520 00000100:00100000:0.0:1788526706.177640:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939520 00000100:00100000:0.0:1788526706.177721:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1788526706.177733:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:9983:x1875405868939520:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526706.177759:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.177799:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594ed expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526706.177833:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ac06f, atime: 0x6a9ac06d, ctime: 0x6a9ac06f, blocks: 0xb 00010000:00010000:0.0:1788526706.177863:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1788526706.177886:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526706.177897:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.177929:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.177945:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820000, rc 0) 00000100:00100000:0.0:1788526706.178009:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e67b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:9983:x1875405868939520:12345-192.168.204.59@tcp:101:bash.0 Request processed in 278us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526706.178016:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1788526706.182012:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.182532:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939648 00000100:00100000:2.0:1788526706.182546:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939648 00002000:00010000:2.0:1788526706.182603:0:6674:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788526706.182608:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26ea4a300 with x1875405868939648 ext(0->18446744073709551615) 00002000:00010000:2.0:1788526706.182623:0:6674:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26ea4a300. 00000100:00100000:2.0:1788526706.182655:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1788526706.182666:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2351:x1875405868939648:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:2.0:1788526706.183188:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788526706.183192:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788526703 -> 1788526705 00002000:00010000:2.0:1788526706.183195:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788526701 -> 1788526701 00002000:00010000:2.0:1788526706.183213:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788526703 -> 1788526705 00002000:00010000:2.0:1788526706.183215:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788526706.183359:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2351:x1875405868939648:12345-192.168.204.59@tcp:10:bash.0 Request processed in 692us (1361us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788526706.183370:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00010000:2.0:1788526706.183374:0:6674:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788526706.183416:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26ea4a300 with x1875405868939648 ext(0->18446744073709551615) 00002000:00010000:2.0:1788526706.183423:0:6674:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26ea4a300. 00000100:00100000:1.0:1788526706.242086:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.242184:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868939776 00000100:00100000:3.0:1788526706.242199:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868939776 00000100:00100000:3.0:1788526706.242284:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:3.0:1788526706.242295:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+27:10469:x1875405868939776:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1788526706.242445:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242467:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242482:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242500:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242508:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242514:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242884:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242895:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242902:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526706.242960:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242974:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242981:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242987:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.242994:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.243000:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243008:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243022:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526706.243025:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.243031:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243045:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243061:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243067:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243072:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243077:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.243081:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243088:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243096:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526706.243098:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.243101:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243107:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a87b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243124:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243130:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243142:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243147:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.243150:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243156:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243164:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:3.0:1788526706.243167:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.243170:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.243176:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.243284:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+27:10469:x1875405868939776:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 988us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526706.243293:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:0.0:1788526706.294472:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.294789:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868940032 00000100:00100000:3.0:1788526706.294804:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868940032 00000100:00100000:3.0:1788526706.294888:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1788526706.294911:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+27:10472:x1875405868940032:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526706.294941:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526706.294972:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594f4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295121:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295141:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295157:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295175:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295183:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295190:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295601:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a89e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295612:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a89e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295619:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a89e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526706.295631:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788526706.295751:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295759:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295775:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295782:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.295787:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295797:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295813:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526706.295817:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.295823:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295830:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295845:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295852:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295858:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295864:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.295867:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295884:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295893:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526706.295895:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.295898:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295904:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295957:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594f4 expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295974:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a89e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594f4 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.295982:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:3.0:1788526706.295984:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788526706.295987:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526706.296079:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+29:10472:x1875405868940032:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1180us (1624us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788526706.296088:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:0.0:1788526706.303769:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.303876:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868940160 00000100:00100000:3.0:1788526706.303889:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868940160 00000100:00100000:3.0:1788526706.303974:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:3.0:1788526706.303987:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+29:10472:x1875405868940160:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1788526706.304109:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.304129:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.304140:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.304187:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.304204:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 29 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.304220:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881548928:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526706.304358:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788526706.316593:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.316730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868940416 00000100:00100000:0.0:1788526706.316744:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868940416 00000100:00100000:0.0:1788526706.316826:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1788526706.316836:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+30:5588:x1875405868940416:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788526706.317312:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:5588:x1875405868940416:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 476us (732us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788526706.317320:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1788526706.318593:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881548928:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526706.318636:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.320171:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.320302:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868940544 00000100:00100000:1.0:1788526706.320312:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868940544 00010000:00010000:1.0:1788526706.320367:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 31 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.320478:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1788526706.320489:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:2349:x1875405868940544:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526706.320508:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526706.320516:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 31 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320530:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 31 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320557:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3a851 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594df expref: 31 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320576:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:1.0:1788526706.320582:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320593:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320602:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.320713:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526706.320781:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+30:2349:x1875405868940544:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 293us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526706.320789:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00010000:00010000:3.0:1788526706.325730:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.325754:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332080:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332102:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332110:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332118:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.332124:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332134:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332157:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526706.332161:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526706.332167:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.332173:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a8ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526706.332478:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+29:10472:x1875405868940160:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 28486us (28720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526706.332490:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1788526706.341694:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.343002:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868940800 00000100:00100000:2.0:1788526706.343022:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868940800 00000100:00100000:2.0:1788526706.343371:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1788526706.343421:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+29:10472:x1875405868940800:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526706.343786:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+30:10472:x1875405868940800:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 369us (2109us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788526706.343794:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1788526706.476729:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.477117:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868941056 00000100:00100000:3.0:1788526706.477132:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868941056 00000100:00100000:3.0:1788526706.477232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:3.0:1788526706.477245:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+30:10483:x1875405868941056:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:3.0:1788526706.477292:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526706.477321:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a8b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc594fb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477463:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477482:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477496:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477514:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477522:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.477529:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.480877:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.480917:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.480933:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526706.480973:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788526706.481120:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481129:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481137:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481144:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.481149:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481158:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481173:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526706.481177:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.481183:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481190:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481210:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481217:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.481236:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.483930:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.483941:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.483955:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.483979:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526706.483983:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.483990:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.483998:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a8c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.484115:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a8b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594fb expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.484134:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594fb expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.484142:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:3.0:1788526706.484144:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526706.484147:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:3.0:1788526706.484265:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+32:10483:x1875405868941056:12345-192.168.204.59@tcp:101:cat.0 Request processed in 7012us (7540us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788526706.484300:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:0.0:1788526706.497134:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.497266:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868941312 00000100:00100000:1.0:1788526706.497298:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868941312 00000100:00100000:1.0:1788526706.497383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1788526706.497437:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+32:10483:x1875405868941312:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1788526706.497963:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+33:10483:x1875405868941312:12345-192.168.204.59@tcp:35:cat.0 Request processed in 527us (845us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788526706.497972:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1788526706.558189:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.558295:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868941568 00000100:00100000:2.0:1788526706.558310:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868941568 00000100:00100000:2.0:1788526706.558456:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:2.0:1788526706.558469:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+33:10484:x1875405868941568:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:2.0:1788526706.558569:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788526706.558614:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594fb expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558647:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a89e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594f4 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558663:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a866 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594e6 expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558675:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526706.558711:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526706.558745:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558765:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558777:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558793:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558800:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.558807:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.559316:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.559326:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.559334:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526706.560112:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788526706.560124:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341900736698ns, next at 342900734045ns, rc = 0 00010000:00010000:2.0:1788526706.560199:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560221:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560231:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560240:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560247:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560265:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560294:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526706.560322:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560328:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560335:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560342:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.560348:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560358:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560383:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:2.0:1788526706.560412:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788526706.560417:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560424:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3a8e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560443:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560450:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560455:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560460:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526706.560463:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560468:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560476:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526706.560479:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526706.560482:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.560487:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3a8d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526706.560508:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c6a1aa5 reply state 0000000079d4c03b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526706.560518:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526706.560641:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+32:10484:x1875405868941568:12345-192.168.204.59@tcp:36:rm.0 Request processed in 2171us (2464us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788526706.560650:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00010000:00010000:3.0:1788526706.563889:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526706.563920:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.563935:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526706.563941:0:7617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.563953:0:7617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.563978:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:3.0:1788526706.563982:0:7617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788526706.563988:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.563995:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3a8eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.564027:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526706.564029:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526706.564032:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526706.571096:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571122:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571131:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571163:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526706.571169:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571179:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571200:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c260d60200) 00010000:00010000:3.0:1788526706.571203:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526706.571209:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.571216:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3a8dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.616460:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.616605:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868941824 00000100:00100000:0.0:1788526706.616622:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868941824 00000100:00100000:0.0:1788526706.616722:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:0.0:1788526706.616734:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+31:10490:x1875405868941824:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526706.616769:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.616797:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a8f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59502 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.616972:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.616992:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.617006:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.617025:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.617032:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.617039:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788526706.617855:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788526706.618070:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618084:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618093:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618145:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618153:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618160:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618166:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526706.618172:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618181:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618196:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526706.618199:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526706.618205:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618211:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a8f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526706.618227:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000214d0186 reply state 0000000080936dfe transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.618238:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788526706.618292:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3a8f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618320:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.618328:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:0.0:1788526706.618331:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526706.618333:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820e00, rc 0) 00000100:00100000:0.0:1788526706.618495:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+34:10490:x1875405868941824:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1762us (2050us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788526706.618504:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00010000:00010000:1.0:1788526706.624918:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.624944:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.624954:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.624962:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526706.624970:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.624980:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.625005:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c243972700) 00010000:00010000:1.0:1788526706.625010:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526706.625015:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.625022:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a900 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.628291:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.628869:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868941952 00000100:00100000:3.0:1788526706.628883:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868941952 00000100:00100000:3.0:1788526706.628975:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1788526706.628987:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868941952:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526706.629011:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526706.629040:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59509 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526706.629077:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526706.629104:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788526706.629110:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526706.629122:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.629173:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.629190:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55600, rc 0) 00000100:00100000:3.0:1788526706.629284:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868941952:12345-192.168.204.59@tcp:101:bash.0 Request processed in 299us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526706.629292:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:2.0:1788526706.632976:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.633126:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868942080 00000100:00100000:0.0:1788526706.633139:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868942080 00000100:00100000:0.0:1788526706.633214:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1788526706.633226:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:10490:x1875405868942080:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526706.633286:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.633311:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59510 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.633353:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.633362:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526706.633366:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526706.633381:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.633499:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.633515:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 7 pid: 6670 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.633532:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6669:1875405881549056:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526706.633640:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526706.637354:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.637521:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868942208 00000100:00100000:1.0:1788526706.637534:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868942208 00010000:00010000:1.0:1788526706.637592:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 8 pid: 6670 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.637640:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1788526706.637651:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868942208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526706.637672:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526706.637702:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 8 pid: 6670 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.637717:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 8 pid: 6670 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.637751:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526706.637769:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526706.637780:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.637791:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.637841:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.637885:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea48a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881549184:192.168.204.59@tcp:105: 00000100:00100000:1.0:1788526706.638006:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788526706.641875:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d61f366/0x367645d450b3a915 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59509 expref: 8 pid: 6670 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.641922:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6669:1875405881549056:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526706.641966:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.641985:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821e00, rc 0) 00000100:00100000:0.0:1788526706.642103:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:10490:x1875405868942080:12345-192.168.204.59@tcp:101:bash.0 Request processed in 8878us (9142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526706.642113:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1788526706.656873:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.656992:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868942464 00000100:00100000:0.0:1788526706.657006:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868942464 00000100:00100000:0.0:1788526706.657085:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1788526706.657098:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+33:10490:x1875405868942464:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1788526706.657684:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+34:10490:x1875405868942464:12345-192.168.204.59@tcp:35:bash.0 Request processed in 586us (823us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788526706.657694:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1788526706.658017:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea48a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881549184:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526706.658049:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526706.658083:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868942208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 20433us (20747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526706.658093:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00010000:00010000:3.0:1788526706.899855:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526706.907237:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.907382:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868942592 00000100:00100000:0.0:1788526706.907444:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868942592 00000100:00100000:0.0:1788526706.907523:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:0.0:1788526706.907536:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+34:10506:x1875405868942592:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526706.907568:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.907597:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59517 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907703:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907722:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907737:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526706.907784:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788526706.907789:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526706.907812:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907843:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59517 expref: 36 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907864:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59517 expref: 35 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.907892:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526706.907895:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526706.907899:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526706.907988:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+35:10506:x1875405868942592:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 454us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526706.907996:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1788526706.912916:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.913187:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868942848 00000100:00100000:0.0:1788526706.913200:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868942848 00000100:00100000:0.0:1788526706.913289:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:0.0:1788526706.913300:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+35:10506:x1875405868942848:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526706.913329:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.913355:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5951e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.913522:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.913540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.913556:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526706.913569:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788526706.913759:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5951e expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.913805:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5951e expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.913814:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:0.0:1788526706.913818:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526706.913823:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820200, rc 0) 00000100:00100000:0.0:1788526706.913906:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+37:10506:x1875405868942848:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 607us (1016us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788526706.913914:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:1.0:1788526706.917780:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.918782:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943104 00000100:00100000:0.0:1788526706.918798:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943104 00000100:00100000:0.0:1788526706.918885:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1788526706.918897:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+37:10506:x1875405868943104:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526706.918933:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526706.918965:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a946 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59525 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.919136:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.919159:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.919175:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526706.919191:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788526706.919375:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a946 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59525 expref: 40 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.919421:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59525 expref: 39 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.919432:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:0.0:1788526706.919436:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788526706.919440:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821a00, rc 0) 00000100:00100000:0.0:1788526706.919541:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+39:10506:x1875405868943104:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 646us (1777us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788526706.919549:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1788526706.929272:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.929328:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526706.929909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943232 00000100:00100000:2.0:1788526706.929926:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943232 00000100:00100000:2.0:1788526706.930045:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1788526706.930058:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+39:2349:x1875405868943232:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526706.930080:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526706.930112:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3a938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5951e expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526706.930136:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:2.0:1788526706.930142:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526706.930218:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+38:2349:x1875405868943232:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 162us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526706.930225:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1788526706.931149:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943360 00000100:00100000:3.0:1788526706.931162:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943360 00000100:00100000:3.0:1788526706.931225:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1788526706.931237:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868943360:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:3.0:1788526706.931312:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.931339:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.931350:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788526706.931355:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526706.931361:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.931445:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.931491:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 6 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.931510:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881549312:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526706.931627:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788526706.949716:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.949968:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943488 00000100:00100000:0.0:1788526706.949982:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943488 00002000:00100000:0.0:1788526706.950057:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98c14211df80 x1875405868943488/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:422/0 lens 504/0 e 0 to 0 dl 1788526717 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526706.950070:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14211df80 with x1875405868943488 ext(0->8) 00010000:00010000:0.0:1788526706.950083:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 7 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.950102:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 7 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526706.950111:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c14211df80 00000100:00100000:0.0:1788526706.950151:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526706.950163:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868943488:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:0.0:1788526706.950931:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868943488:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 764us (1229us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788526706.950947:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00100000:0.0:1788526706.950956:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98c14211df80 x1875405868943488/t4294967302(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:422/0 lens 504/448 e 0 to 0 dl 1788526717 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526706.950966:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c14211df80 with x1875405868943488 ext(0->8) 00010000:00010000:0.0:1788526706.950973:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.950987:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526706.950994:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c14211df80 00000100:00100000:3.0:1788526706.952213:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881549312:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526706.952260:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526706.964170:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526706.964334:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943616 00000100:00100000:1.0:1788526706.964349:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943616 00010000:00010000:1.0:1788526706.964446:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.964503:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1788526706.964517:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:2348:x1875405868943616:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526706.964539:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788526706.964565:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788526706.964569:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788526705 00002000:00010000:1.0:1788526706.964572:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788526706 00002000:00010000:1.0:1788526706.964575:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788526705 00010000:00010000:1.0:1788526706.964605:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.964622:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.964655:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3a91c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59510 expref: 9 pid: 6669 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.964676:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526706.964681:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526706.964689:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.964700:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.964740:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526706.964823:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868943616:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 307us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526706.964831:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00010000:00010000:3.0:1788526706.966227:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966259:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966310:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966321:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966332:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966560:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526706.966567:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966580:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966602:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.966612:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005175b1d5/0x367645d450b3a95b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.966736:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2350:x1875405868943360:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 35498us (37403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526706.966747:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1788526706.969880:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526706.970095:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868943872 00000100:00100000:0.0:1788526706.970114:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868943872 00000100:00100000:0.0:1788526706.970210:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1788526706.970224:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+38:10506:x1875405868943872:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:0.0:1788526706.970342:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59525 expref: 38 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526706.970810:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788526706.970863:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788526706.971309:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788526706.971379:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.971433:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.971459:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.971508:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.971528:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 42 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.971546:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875405881549440:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526706.971678:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526706.977593:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526706.978081:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944000 00000100:00100000:3.0:1788526706.978094:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944000 00010000:00010000:3.0:1788526706.978152:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 43 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526706.978203:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:3.0:1788526706.978215:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+43:2349:x1875405868944000:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526706.978234:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526706.978268:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 43 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.978285:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 43 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.978316:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:3.0:1788526706.978322:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.978335:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.978344:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526706.978368:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526706.978459:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+43:2349:x1875405868944000:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 246us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526706.978467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00010000:00010000:0.0:1788526706.979616:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59502 expref: 42 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526706.979642:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875405881549440:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526706.979673:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.979684:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526706.979691:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526706.979869:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788526706.980149:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788526706.980297:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875405881549568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788526706.981405:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526706.981514:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526706.982125:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881549568 00000100:00100000:2.0:1788526706.982158:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881549568 00000100:00100000:2.0:1788526706.982327:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526706.982340:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5826:x1875405881549568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788526706.982544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5826:x1875405881549568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 207us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526706.982553:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788526706.982710:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875405881549568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788526706.983473:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788526706.983583:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e810700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875405881549696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788526706.983658:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526706.983700:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551840 going to sleep for 11 seconds 00000100:00100000:3.0:1788526706.984174:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881549696 00000100:00100000:3.0:1788526706.984185:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881549696 00000100:00100000:3.0:1788526706.984231:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526706.984240:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1875405881549696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788526706.984516:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5826:x1875405881549696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 276us (857us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788526706.984526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526706.984982:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e810700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875405881549696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788526706.989379:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788526706.989520:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989535:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989543:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989550:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526706.989557:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989568:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989595:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:1.0:1788526706.989599:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788526706.989606:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526706.989613:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3a962 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788526706.990083:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788526706.990224:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788526706.990238:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342330850840ns, next at 343330848220ns, rc = 0 00000001:00080000:1.0:1788526706.990381:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788526706.990499:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c243972100) 00010000:00010000:1.0:1788526706.990504:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788526706.990516:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3a94d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59525 expref: 46 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526706.991148:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+45:10506:x1875405868943872:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 20922us (21279us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788526706.991161:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000020:00080000:1.0:1788526706.991169:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788526706.991437:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526707.002052:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.005048:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944128 00000100:00100000:0.0:1788526707.005071:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944128 00000100:00100000:1.0:1788526707.007615:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1788526707.007637:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+45:10506:x1875405868944128:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526707.007686:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526707.007719:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a969 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5952c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.007809:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5952c expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.007827:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a969 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5952c expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.007853:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.007856:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526707.007861:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111000, rc 0) 00000100:00100000:1.0:1788526707.008163:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:10506:x1875405868944128:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 533us (6125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.008172:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00080000:0.0:1788526707.008303:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526707.012791:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.012934:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944384 00000100:00100000:3.0:1788526707.012946:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944384 00000100:00100000:3.0:1788526707.013046:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1788526707.013059:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:10506:x1875405868944384:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526707.013601:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+47:10506:x1875405868944384:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 542us (825us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788526707.013610:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1788526707.187256:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.192302:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944512 00000100:00100000:1.0:1788526707.192341:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944512 00000100:00100000:0.0:1788526707.192529:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1788526707.192546:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+47:10516:x1875405868944512:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1788526707.192665:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192688:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192703:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192723:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192731:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192738:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192879:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192901:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.192937:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526707.192992:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193009:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193017:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193024:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193043:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526707.193049:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193058:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193073:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526707.193076:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526707.193083:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193088:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a970 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193105:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193117:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193122:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193127:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526707.193130:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193136:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193144:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c243972000) 00010000:00010000:0.0:1788526707.193147:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526707.193149:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193155:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193171:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193177:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193183:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193188:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526707.193197:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193204:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193212:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:0.0:1788526707.193215:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526707.193218:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.193225:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a97e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.193346:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+47:10516:x1875405868944512:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 803us (6115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526707.193355:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:1.0:1788526707.283590:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.283709:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944768 00000100:00100000:3.0:1788526707.283724:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944768 00000100:00100000:3.0:1788526707.283818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1788526707.283829:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+47:10519:x1875405868944768:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526707.283857:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.283897:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a985 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59533 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284010:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284030:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284045:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284065:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284081:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284282:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a99a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284292:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284299:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526707.284310:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788526707.284493:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284502:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284510:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284518:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526707.284524:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284533:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284548:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526707.284551:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526707.284558:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284576:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a98c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284594:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284601:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284606:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284612:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526707.284615:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284621:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284630:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526707.284633:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526707.284637:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284643:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a985 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59533 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284709:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a99a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59533 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.284724:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.284727:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526707.284730:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526707.284819:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+49:10519:x1875405868944768:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 991us (1245us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788526707.284828:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:2.0:1788526707.294522:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.294655:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868944896 00000100:00100000:1.0:1788526707.294682:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868944896 00000100:00100000:1.0:1788526707.294759:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:1.0:1788526707.294770:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+49:10519:x1875405868944896:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1788526707.294877:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294900:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294914:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294953:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294960:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294969:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294975:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526707.294982:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.294991:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.295030:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.295033:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526707.295041:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.295048:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.295141:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+49:10519:x1875405868944896:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 372us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.295149:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1788526707.301474:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.301597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868945152 00000100:00100000:1.0:1788526707.301611:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868945152 00000100:00100000:1.0:1788526707.301690:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1788526707.301702:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+49:10519:x1875405868945152:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526707.302339:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:10519:x1875405868945152:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 636us (878us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788526707.302348:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:2.0:1788526707.421043:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.421097:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868945408 00000100:00100000:3.0:1788526707.421107:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868945408 00000100:00100000:3.0:1788526707.421181:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:3.0:1788526707.421191:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+50:10529:x1875405868945408:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526707.421215:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.421219:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788526707.421357:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3a92a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59517 expref: 50 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.421379:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526707.421460:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526707.421495:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a9af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5953a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.422722:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.422745:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.422941:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526707.422968:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788526707.423658:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a9af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5953a expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.423684:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5953a expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.423693:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.423696:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526707.423700:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55600, rc 0) 00000100:00100000:3.0:1788526707.424102:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+51:10529:x1875405868945408:12345-192.168.204.59@tcp:101:bash.0 Request processed in 2910us (3064us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788526707.424112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:2.0:1788526707.427920:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.430424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868945664 00000100:00100000:1.0:1788526707.430440:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868945664 00000100:00100000:1.0:1788526707.430574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:1.0:1788526707.430586:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+51:10529:x1875405868945664:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:1.0:1788526707.430665:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788526707.430703:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3a9b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5953a expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.430728:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3a99a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59533 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.430752:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.430756:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526707.430975:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.430989:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.430999:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526707.431048:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788526707.431070:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b372cc0 reply state 0000000065c91c54 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.431079:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526707.431564:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+52:10529:x1875405868945664:12345-192.168.204.59@tcp:36:bash.0 Request processed in 978us (3653us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788526707.431572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000020:00080000:1.0:1788526707.431578:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788526707.436622:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436644:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436654:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436660:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526707.436666:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436689:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436730:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.436733:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526707.436739:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.436746:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3a9c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526707.439278:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.443206:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868945792 00000100:00100000:0.0:1788526707.443229:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868945792 00000100:00100000:0.0:1788526707.443377:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:0.0:1788526707.443409:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:10529:x1875405868945792:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526707.443504:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526707.443531:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a9cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59541 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443629:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443648:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443682:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526707.443712:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788526707.443716:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526707.443736:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443915:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a9cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443935:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.443945:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:0.0:1788526707.443948:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526707.443952:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526707.444020:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+52:10529:x1875405868945792:12345-192.168.204.59@tcp:101:bash.0 Request processed in 611us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526707.446703:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:2.0:1788526707.454847:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.455027:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946048 00000100:00100000:3.0:1788526707.455043:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946048 00000100:00100000:3.0:1788526707.455128:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:3.0:1788526707.455143:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:10529:x1875405868946048:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1788526707.455717:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+53:10529:x1875405868946048:12345-192.168.204.59@tcp:35:bash.0 Request processed in 575us (883us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788526707.455728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1788526707.538984:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.540107:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946176 00000100:00100000:0.0:1788526707.540123:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946176 00000100:00100000:0.0:1788526707.540207:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1788526707.540219:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+53:10535:x1875405868946176:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526707.540271:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526707.540301:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a9d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59548 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540620:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540641:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540656:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526707.540704:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788526707.540708:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526707.540731:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540765:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3a9d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59548 expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540787:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59548 expref: 54 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.540796:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526707.540799:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526707.540804:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820e00, rc 0) 00000100:00100000:0.0:1788526707.540952:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868946176:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 664us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526707.540962:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:1.0:1788526707.547784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.548077:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946304 00000100:00100000:3.0:1788526707.548092:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946304 00000100:00100000:3.0:1788526707.548161:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:3.0:1788526707.548172:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868946304:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526707.548201:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.548230:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a9e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5954f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548345:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548438:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548485:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548493:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548501:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548629:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548639:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548646:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526707.548704:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788526707.548710:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526707.548738:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548755:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548765:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548772:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548791:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548798:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526707.548804:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548814:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548831:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:3.0:1788526707.548835:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526707.548840:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548848:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3a9ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548865:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548872:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548878:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548896:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526707.548899:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548917:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548926:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c242a8b500) 00010000:00010000:3.0:1788526707.548929:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526707.548932:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548938:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3a9f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548981:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3a9e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.548996:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.549002:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.549004:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526707.549007:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54600, rc 0) 00000100:00100000:3.0:1788526707.549094:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:10535:x1875405868946304:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 924us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.549103:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:2.0:1788526707.557124:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.557224:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946560 00000100:00100000:1.0:1788526707.557245:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946560 00000100:00100000:2.0:1788526707.557250:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.557298:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:1.0:1788526707.557310:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+55:10535:x1875405868946560:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526707.557333:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526707.557356:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59556 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557542:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557558:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557566:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557575:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557615:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557630:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.557644:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e810a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881549824:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526707.557761:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.557771:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 56 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.557779:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881549952:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526707.557817:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526707.558288:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946688 00000100:00100000:3.0:1788526707.558302:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946688 00010000:00010000:3.0:1788526707.558370:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.558465:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1788526707.558476:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:2351:x1875405868946688:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526707.558498:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526707.558508:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.558523:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.558551:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.558557:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.558566:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.558572:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526707.558639:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:2351:x1875405868946688:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 165us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.558647:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:2.0:1788526707.566846:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.566957:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868946816 00000100:00100000:3.0:1788526707.566971:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868946816 00010000:00010000:3.0:1788526707.567045:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.567095:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1788526707.567106:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:2349:x1875405868946816:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526707.567144:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526707.567152:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.567167:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 57 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.567198:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.567204:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.567216:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.567225:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.567260:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526707.567336:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:2349:x1875405868946816:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 231us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.567344:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00010000:00010000:1.0:1788526707.569486:0:6721:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.59@tcp) returned -22 from blocking AST (req@000000008429d982 x1875405881549824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.569515:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3a9fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5954f expref: 56 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.569539:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e810a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881549824:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526707.569560:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3a9d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59541 expref: 55 pid: 5823 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.569571:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e810e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881549952:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526707.569608:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.569618:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.569629:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.569636:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526707.569666:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788526707.569904:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 56 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.569922:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 55 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.569948:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.569951:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526707.569954:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110400, rc 0) 00000100:00100000:1.0:1788526707.570057:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+55:10535:x1875405868946560:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 12748us (12943us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788526707.570067:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:2.0:1788526707.577215:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.578015:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947072 00000100:00100000:3.0:1788526707.578033:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947072 00000100:00100000:3.0:1788526707.578145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1788526707.578159:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:10535:x1875405868947072:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:3.0:1788526707.578184:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526707.578225:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3a969 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5952c expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.578289:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526707.578296:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526707.579049:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868947072:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 230us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.579062:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526707.586096:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.586192:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947200 00000100:00100000:3.0:1788526707.586208:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947200 00000100:00100000:3.0:1788526707.586298:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:3.0:1788526707.586309:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868947200:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:3.0:1788526707.586530:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.586555:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.586570:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526707.586843:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788526707.587169:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868947200:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 858us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.587179:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:2.0:1788526707.591513:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.591710:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947328 00000100:00100000:1.0:1788526707.591727:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947328 00000100:00100000:1.0:1788526707.591810:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00100000:1.0:1788526707.591824:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:10535:x1875405868947328:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526707.591862:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526707.591911:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5955d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592009:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592022:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592048:0:5824:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592065:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592106:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.592110:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526707.592115:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.592124:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111c00, rc 0) 00000100:00100000:1.0:1788526707.592211:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+55:10535:x1875405868947328:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 390us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.592219:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 111 00000040:00080000:1.0:1788526707.604085:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526707.604100:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526707.604177:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788526707.604186:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526707.604561:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e810e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881550080:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788526707.604814:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c246402cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526707.609662:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.610018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947456 00000100:00100000:3.0:1788526707.610031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947456 00000100:00100000:3.0:1788526707.610109:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:3.0:1788526707.610120:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868947456:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788526707.610194:0:5823:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788526707.610364:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868947456:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 244us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.610372:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:1.0:1788526707.613075:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e810e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881550080:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788526707.614288:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.614730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947584 00000100:00100000:1.0:1788526707.614816:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947584 00000100:00100000:1.0:1788526707.614963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:1.0:1788526707.614977:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+55:10536:x1875405868947584:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788526707.615097:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615119:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615156:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615175:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615184:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615191:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615223:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615245:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615252:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526707.615306:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788526707.615312:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526707.615330:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615343:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615351:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.615382:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617018:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526707.617084:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617098:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617119:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:1.0:1788526707.617123:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526707.617130:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617140:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3aa26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617162:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617169:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617176:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617182:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526707.617184:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617216:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617226:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98c272284100) 00010000:00010000:1.0:1788526707.617228:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526707.617243:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617250:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617275:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617282:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617288:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617294:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526707.617297:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617303:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617311:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526707.617313:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526707.617316:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.617332:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.618092:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+55:10536:x1875405868947584:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 3108us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.618106:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:2.0:1788526707.625328:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.625523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947840 00000100:00100000:3.0:1788526707.625540:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947840 00000100:00100000:3.0:1788526707.625634:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:3.0:1788526707.625653:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:10536:x1875405868947840:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526707.625696:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.625731:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3aa3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59564 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.626610:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.626634:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.626650:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526707.626665:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788526707.629149:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629188:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629197:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629205:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526707.629211:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629220:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629256:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:2.0:1788526707.629260:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788526707.629266:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629274:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aa42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629366:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3aa3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59564 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629379:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:2.0:1788526707.629381:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526707.629411:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3aa3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59564 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.629422:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:2.0:1788526707.629539:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868947840:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3889us (4230us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788526707.629551:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:2.0:1788526707.632918:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.633324:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868947968 00000100:00100000:0.0:1788526707.633369:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868947968 00000100:00100000:0.0:1788526707.633479:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1788526707.633491:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868947968:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788526707.633543:0:6721:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788526707.633688:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868947968:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 199us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526707.633699:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1788526707.638842:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526707.639060:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868948224 00000100:00100000:2.0:1788526707.639074:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868948224 00000100:00100000:2.0:1788526707.639153:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:2.0:1788526707.639166:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868948224:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526707.639193:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526707.639198:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788526707.639249:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3a9e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59548 expref: 56 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.639273:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526707.639280:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526707.639299:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3aa50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5956b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526707.640372:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788526707.651329:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3aa57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.651356:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.651382:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.651509:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3aa50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5956b expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.651547:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3aa57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5956b expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.651557:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c260d60900) 00010000:00010000:2.0:1788526707.651560:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526707.651564:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76000, rc 0) 00000100:00100000:2.0:1788526707.651646:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:10536:x1875405868948224:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 12482us (12819us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788526707.651655:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:3.0:1788526707.656269:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.657070:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868948480 00000100:00100000:0.0:1788526707.657086:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868948480 00000100:00100000:0.0:1788526707.657169:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:0.0:1788526707.657182:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+57:10536:x1875405868948480:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788526707.657279:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526707.657319:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3aa57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5956b expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657345:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c260d60900) 00010000:00010000:0.0:1788526707.657658:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526707.657692:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657712:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657724:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657757:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657784:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657791:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657879:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657887:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657896:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657903:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526707.657908:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657917:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657925:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:0.0:1788526707.657928:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526707.657933:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657938:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aa65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657948:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657962:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657968:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657972:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526707.657975:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657981:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657988:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe4d84da5 (ffff98c243972000) 00010000:00010000:0.0:1788526707.657991:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526707.657993:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.657999:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aa6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe4d84da5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.658127:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868948480:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 946us (1871us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526707.658136:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:3.0:1788526707.661478:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.661592:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868948608 00000100:00100000:0.0:1788526707.661610:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868948608 00000100:00100000:0.0:1788526707.661700:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:0.0:1788526707.661713:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:10536:x1875405868948608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526707.661755:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526707.661812:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3aa73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59572 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.661952:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.661978:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.661995:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.662112:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3aa73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.662137:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.662146:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526707.662149:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526707.662153:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:1.0:1788526707.662252:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:10536:x1875405868948608:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 540us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.662261:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:2.0:1788526707.665761:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.666059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868948864 00000100:00100000:1.0:1788526707.666091:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868948864 00000100:00100000:1.0:1788526707.666165:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:1.0:1788526707.666176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+57:10536:x1875405868948864:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526707.666289:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.666306:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.666318:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526707.666625:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788526707.666639:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343007251081ns, next at 344007247074ns, rc = 0 00000004:00010000:1.0:1788526707.666725:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f5cd985 reply state 0000000053159c62 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.666736:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526707.669787:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+59:10536:x1875405868948864:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 3598us (4037us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788526707.669802:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:2.0:1788526707.677666:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.678024:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868948992 00000100:00100000:3.0:1788526707.678040:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868948992 00000100:00100000:3.0:1788526707.678121:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:3.0:1788526707.678134:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+59:10536:x1875405868948992:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526707.678171:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.678201:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59579 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.678320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.678339:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.678372:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:3.0:1788526707.678376:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526707.678381:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55a00, rc 0) 00000100:00100000:3.0:1788526707.678473:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:10536:x1875405868948992:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 341us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.678480:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00010000:00010000:1.0:1788526707.682242:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.682254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1788526707.682272:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.682282:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.682289:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110a00 already unused, calling callback (ffffffffc1f6a4f0) 00000100:00100000:0.0:1788526707.682312:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868949120 00010000:00010000:1.0:1788526707.682313:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.682326:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.682329:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868949120 00010000:00010000:1.0:1788526707.682353:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526707.682356:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526707.682362:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.682370:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3aa81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.682465:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1788526707.682482:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868949120:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788526707.682897:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868949120:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 418us (675us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788526707.682905:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00080000:0.0:1788526707.682937:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788526707.686375:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526707.686587:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868949376 00000100:00100000:2.0:1788526707.686601:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868949376 00000100:00100000:2.0:1788526707.686671:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1788526707.686683:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+59:10536:x1875405868949376:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788526707.687025:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:10536:x1875405868949376:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 343us (660us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788526707.687034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1788526707.689551:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.689659:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868949632 00000100:00100000:0.0:1788526707.689671:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868949632 00000100:00100000:0.0:1788526707.689750:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:0.0:1788526707.689761:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+60:10536:x1875405868949632:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788526707.689907:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+60:10536:x1875405868949632:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 148us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526707.689915:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:1.0:1788526707.701721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.705114:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868949760 00000100:00100000:3.0:1788526707.705133:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868949760 00000100:00100000:2.0:1788526707.705271:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:2.0:1788526707.705285:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:10536:x1875405868949760:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526707.705315:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526707.705344:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3aa8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59580 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705515:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705534:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705548:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526707.705597:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526707.705621:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705655:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3aa8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59580 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705672:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59580 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.705680:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526707.705683:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788526707.705688:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77e00, rc 0) 00000100:00100000:2.0:1788526707.709121:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:10536:x1875405868949760:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3818us (7397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526707.709136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:2.0:1788526707.712049:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.712135:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868949888 00000100:00100000:1.0:1788526707.712149:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868949888 00000100:00100000:1.0:1788526707.712225:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:1.0:1788526707.712247:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+9:2350:x1875405868949888:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526707.712275:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526707.712304:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59587 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788526707.712339:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac072, blocks: 0x1 00010000:00010000:1.0:1788526707.712377:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1788526707.712382:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526707.712422:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.712473:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 10 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.712489:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110a00, rc 0) 00000100:00100000:1.0:1788526707.712561:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+10:2350:x1875405868949888:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 327us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.712568:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1788526707.715447:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.715679:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950144 00000100:00100000:1.0:1788526707.715693:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950144 00000100:00100000:1.0:1788526707.715776:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1788526707.715787:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:10536:x1875405868950144:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788526707.716095:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:10536:x1875405868950144:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 308us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.716104:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:2.0:1788526707.718974:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.719263:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950272 00000100:00100000:3.0:1788526707.719277:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950272 00000100:00100000:3.0:1788526707.719363:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1788526707.719375:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+10:10536:x1875405868950272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526707.719431:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526707.719459:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5958e expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.719502:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.719535:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526707.719541:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526707.719549:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.719598:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.719615:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 11 pid: 8450 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.719632:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881550208:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526707.719754:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526707.729122:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.729456:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950400 00000100:00100000:1.0:1788526707.729469:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950400 00010000:00010000:1.0:1788526707.729523:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 12 pid: 8450 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.729578:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1788526707.729590:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+12:2348:x1875405868950400:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526707.729609:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526707.729639:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 12 pid: 8450 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.729672:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 12 pid: 8450 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.729707:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526707.729713:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526707.729723:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.729735:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526707.729784:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526707.729802:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e810a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1875405881550336:192.168.204.59@tcp:105: 00000100:00100000:1.0:1788526707.729903:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2464023c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788526707.731027:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017aeea2f/0x367645d450b3aa9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59587 expref: 12 pid: 8450 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526707.731061:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881550208:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526707.731094:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.731110:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:2.0:1788526707.731175:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+11:10536:x1875405868950272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 11801us (12215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526707.731184:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1788526707.737820:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e810a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1875405881550336:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526707.737861:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526707.737946:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+10:2348:x1875405868950400:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 8356us (8837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.737960:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1788526707.752564:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526707.752805:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950528 00000100:00100000:0.0:1788526707.752818:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950528 00002000:00100000:0.0:1788526707.753144:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98c26e810a80 x1875405868950528/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:423/0 lens 504/0 e 0 to 0 dl 1788526718 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526707.753157:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26e810a80 with x1875405868950528 ext(0->12) 00002000:00010000:0.0:1788526707.753172:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26e810a80 00000100:00100000:0.0:1788526707.753217:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1788526707.753229:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f122900d-e71c-4fc3-b559-b19040da7c34+10:2348:x1875405868950528:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788526707.754161:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f122900d-e71c-4fc3-b559-b19040da7c34+12:2348:x1875405868950528:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 928us (1605us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788526707.754172:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:0.0:1788526707.754183:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98c26e810a80 x1875405868950528/t4294967308(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:423/0 lens 504/448 e 0 to 0 dl 1788526718 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526707.754193:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26e810a80 with x1875405868950528 ext(0->12) 00002000:00010000:0.0:1788526707.754199:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26e810a80 00000100:00100000:0.0:1788526707.760655:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526707.760790:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950656 00000100:00100000:1.0:1788526707.760805:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950656 00000100:00100000:1.0:1788526707.760914:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:1.0:1788526707.760926:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:10536:x1875405868950656:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788526707.834476:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788526707.834507:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788526707.867833:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:10536:x1875405868950656:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 106890us (107174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526707.867850:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000001:00080000:2.0:1788526707.868016:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967385 is committed 00000001:00080000:2.0:1788526707.868192:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1788526707.868199:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788526707.868247:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788526707.868269:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c27b551600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788526707.868274:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c246185300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c27b551cc0 00000020:00080000:2.0:1788526707.868277:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c246185500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c26e4c6800 00000020:00080000:2.0:1788526707.868303:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c247d84240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788526707.868306:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c246185f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c247d840c0 00000020:00080000:2.0:1788526707.868309:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c246185d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c274a8cc00 00000020:00080000:2.0:1788526707.868318:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1788526707.868325:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788526707.868335:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788526707.868661:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788526707.869531:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881550592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788526707.869624:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526707.869707:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526707.869714:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881550720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788526707.869740:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526707.869785:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881550592 00000100:00100000:3.0:1788526707.869794:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881550592 00000100:00100000:3.0:1788526707.869863:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881550720 00000100:00100000:3.0:1788526707.869867:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881550720 00000100:00100000:3.0:1788526707.869898:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788526707.869922:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875405881550592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788526707.869960:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788526707.869993:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.870020:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.872676:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788526707.872715:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875405881550720:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1788526707.873164:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00010000:0.0:1788526707.873303:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788526707.873307:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788526707 00002000:00010000:0.0:1788526707.873310:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788526707.873313:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788526706 -> 1788526707 00002000:00010000:0.0:1788526707.873316:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788526707.873594:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526707.873623:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881550464:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788526707.873715:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788526707.873959:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788526707.873966:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526707.873976:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.874043:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.874062:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 11 pid: 6669 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.874077:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6670:1875405881550848:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526707.877886:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526707.878117:0:8450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788526707.878132:0:8450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788526707.878908:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3278:x1875405881550720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6207us (9157us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788526707.878923:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788526707.878967:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881550464 00000100:00100000:0.0:1788526707.878979:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881550464 00000100:00100000:0.0:1788526707.879023:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788526707.879032:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881550464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788526707.879088:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788526707.879134:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ac071, atime: 0x6a9ac072, ctime: 0x6a9ac071, blocks: 0xb 00010000:00010000:0.0:1788526707.879143:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.879164:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788526707.879169:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526707.879177:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.879197:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.879209:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.879218:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.879258:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788526707.879570:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c26e813b80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788526707.879579:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881550720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788526707.880547:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1875405881550464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1511us (2682us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788526707.880559:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788526707.881117:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788526707.881128:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:1.0:1788526707.881157:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c26f9d8a80, transno 4294967301 00000004:00080000:1.0:1788526707.881182:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:1.0:1788526707.881208:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98c27b523480 x1875405881550464/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788526723 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788526707.881221:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c27b523480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788526707.881237:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881550464:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788526707.882190:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788526707.885150:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:2.0:1788526707.885216:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526707.885240:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.885258:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526707.885265:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.885281:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.885315:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.885324:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526707.885556:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950784 00000100:00100000:0.0:1788526707.885570:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950784 00000100:00100000:0.0:1788526707.885639:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1788526707.885651:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+12:2349:x1875405868950784:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788526707.886005:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526707.886008:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526707.886009:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526707.890674:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.890816:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6670:1875405881550848:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526707.890856:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.890912:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868950912 00000100:00100000:3.0:1788526707.890940:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868950912 00010000:00010000:3.0:1788526707.890996:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 13 pid: 6669 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526707.891036:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1788526707.891047:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868950912:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526707.891068:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526707.891075:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 13 pid: 6669 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891089:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 13 pid: 6669 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891121:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3a86d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594ed expref: 13 pid: 6669 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891145:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526707.891150:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526707.891157:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891168:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891197:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526707.891284:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+12:2349:x1875405868950912:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 237us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526707.891302:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00010000:00010000:3.0:1788526707.891331:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891340:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891583:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891594:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526707.891612:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526707.891954:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526707.891963:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.891973:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526707.891979:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.891990:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.892006:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.892013:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073eb4ab7/0x367645d450b3aaab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526707.892037:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526707.892039:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526707.892041:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526707.895280:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3278:x1875405881550592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25348us (25644us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788526707.895299:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788526707.895696:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c26e813480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788526707.895706:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881550592:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788526707.928631:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526707.973612:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788526707.973638:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788526707.973943:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868950784:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 88284us (88798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526707.973956:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1788526707.988155:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526707.991475:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951168 00000100:00100000:3.0:1788526707.991499:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951168 00000100:00100000:2.0:1788526707.994802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1788526707.994824:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:10536:x1875405868951168:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788526707.994946:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526707.994986:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3aa96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59580 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.995014:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:2.0:1788526707.995022:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526707.995065:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.995085:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526707.995096:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526707.995519:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fac3ce27 reply state 000000000900126d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526707.995533:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526707.995667:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:10536:x1875405868951168:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 847us (7527us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788526707.995675:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:3.0:1788526707.999999:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:0.0:1788526708.000563:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000581:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000609:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000616:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526708.000623:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000633:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000656:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:0.0:1788526708.000659:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526708.000664:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.000671:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3aab9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526708.002092:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951296 00000100:00100000:0.0:1788526708.002116:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951296 00000100:00100000:0.0:1788526708.002221:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1788526708.002247:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868951296:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788526708.002590:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788526708.002595:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788526707 -> 1788526706 00002000:00010000:0.0:1788526708.002598:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788526706 00002000:00010000:0.0:1788526708.002600:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788526707 -> 1788526706 00002000:00010000:0.0:1788526708.002603:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788526708.002695:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868951296:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 451us (2711us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788526708.002723:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1788526708.018980:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526708.019259:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951552 00000100:00100000:3.0:1788526708.019278:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951552 00000100:00100000:3.0:1788526708.019370:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:3.0:1788526708.019383:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+15:10536:x1875405868951552:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788526708.019545:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.019588:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.019599:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.019649:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.019667:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 15 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.019686:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881550976:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526708.020209:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526708.024845:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526708.030997:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881550976:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526708.031054:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.034585:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951680 00000100:00100000:1.0:1788526708.034618:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951680 00010000:00010000:1.0:1788526708.034703:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.036620:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1788526708.036643:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:2348:x1875405868951680:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526708.036673:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526708.036685:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.036701:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.037179:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3aa7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59572 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.037202:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526708.037208:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.037220:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.037240:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.037282:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526708.037864:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037887:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037931:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037938:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037966:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037973:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526708.037978:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.037987:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.038001:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:3.0:1788526708.038004:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788526708.038008:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.038014:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3aac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.038118:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+15:10536:x1875405868951552:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 18735us (19155us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788526708.038129:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:1.0:1788526708.040048:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+14:2348:x1875405868951680:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3398us (15203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526708.040066:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1788526708.056709:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526708.057250:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951808 00000100:00100000:3.0:1788526708.057268:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951808 00000100:00100000:3.0:1788526708.057537:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1788526708.057554:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868951808:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788526708.057646:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.057681:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.057722:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526708.057740:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526708.057747:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.057818:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.057841:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 7 pid: 6671 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.057863:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881551104:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526708.058014:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788526708.069120:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526708.069470:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868951936 00000100:00100000:1.0:1788526708.069508:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868951936 00010000:00010000:1.0:1788526708.069576:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 8 pid: 6671 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.069629:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1788526708.069641:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868951936:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526708.069663:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526708.069699:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 8 pid: 6671 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.069716:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 8 pid: 6671 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.069755:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526708.069761:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526708.069770:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.069782:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.069814:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526708.070210:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000413ff3de/0x367645d450b3aaa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5958e expref: 8 pid: 6671 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.070245:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881551104:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526708.070276:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.070288:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.070297:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071129:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071145:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071155:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071163:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526708.071169:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071180:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071200:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.071209:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005175b1d5/0x367645d450b3aac7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.071319:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868951936:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1676us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526708.071330:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1788526708.073295:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868951808:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 15722us (16582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526708.073316:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1788526708.081335:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526708.081817:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868952192 00000100:00100000:1.0:1788526708.081837:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868952192 00000100:00100000:1.0:1788526708.082005:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:1.0:1788526708.082019:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:10536:x1875405868952192:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788526708.082164:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.082206:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.082236:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.083659:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.083692:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.083704:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.083762:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.083786:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 15 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.083805:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e812680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881551232:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526708.085597:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b66d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788526708.089780:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e812680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881551232:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526708.089839:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526708.090705:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526708.091446:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868952320 00000100:00100000:1.0:1788526708.091459:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868952320 00010000:00010000:1.0:1788526708.091517:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.091621:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:1.0:1788526708.091654:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+16:2348:x1875405868952320:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526708.091676:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526708.091684:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.091701:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.093021:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3aa88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59579 expref: 16 pid: 5823 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.093206:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:1.0:1788526708.093213:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.093237:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.093247:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526708.093295:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526708.093439:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:2348:x1875405868952320:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1782us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526708.093450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00010000:00010000:2.0:1788526708.093562:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.093573:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526708.095415:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788526708.095660:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788526708.095713:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788526708.096010:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881551360:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788526708.096101:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526708.096137:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2424673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526708.096489:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881551360 00000100:00100000:3.0:1788526708.096500:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881551360 00000100:00100000:3.0:1788526708.096567:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526708.096579:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6721:x1875405881551360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788526708.096702:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6721:x1875405881551360:12345-0@lo:1000:mdt00_003.0 Request processed in 125us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526708.096712:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526708.096783:0:6721:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788526708.096790:0:6721:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788526708.096821:0:6721:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c26e813b80, transno 4294967309 00000100:00100000:3.0:1788526708.096840:0:6721:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98c26e813480 x1875405881550592/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788526723 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526708.096855:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881551360:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788526708.097848:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788526708.097933:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881551488:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788526708.098009:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526708.098056:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881551488 00000100:00100000:3.0:1788526708.098063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881551488 00000100:00100000:3.0:1788526708.098098:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788526708.098106:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6721:x1875405881551488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788526708.098325:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6721:x1875405881551488:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (315us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788526708.098333:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788526708.098358:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526708.098411:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881551488:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788526708.098455:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098476:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098485:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098493:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526708.098501:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098513:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098535:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972c00) 00010000:00010000:3.0:1788526708.098539:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526708.098546:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098553:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3aad5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098594:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098602:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098610:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098615:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526708.098625:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098633:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098642:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526708.098645:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526708.098653:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098666:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098678:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.098710:0:6721:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.098723:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274952a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881551616:192.168.204.59@tcp:105: 00000100:00100000:2.0:1788526708.104894:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526708.107670:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526708.107789:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274952a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881551616:192.168.204.59@tcp:105: 00010000:00010000:0.0:1788526708.107830:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.107844:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3aa18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.107903:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.107923:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.107938:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.108282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868952448 00000100:00100000:1.0:1788526708.108292:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868952448 00000100:00100000:1.0:1788526708.108375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1788526708.108422:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:10535:x1875405868952448:12345-192.168.204.59@tcp:49:lfs.0 00010000:00010000:0.0:1788526708.108661:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108669:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108677:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108699:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526708.108704:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108713:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108734:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:0.0:1788526708.108738:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526708.108743:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108749:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3aadc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108763:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108769:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108776:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108781:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526708.108784:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108790:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108810:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:0.0:1788526708.108813:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788526708.108816:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.108823:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3aace lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526708.113138:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:10535:x1875405868952448:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 4728us (5461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526708.113159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000040:00080000:1.0:1788526708.117107:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526708.117122:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526708.117726:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788526708.117738:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788526708.118147:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+18:10536:x1875405868952192:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 36119us (36823us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788526708.118163:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000020:00080000:0.0:1788526708.118171:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788526708.131711:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526708.131894:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526708.132324:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868952960 00000100:00100000:0.0:1788526708.132338:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868952960 00000100:00100000:0.0:1788526708.132451:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1788526708.132463:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:10535:x1875405868952960:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:0.0:1788526708.133106:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788526708.133241:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:10535:x1875405868952960:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 778us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526708.133251:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1788526708.141719:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868952704 00000100:00100000:2.0:1788526708.141753:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868952704 00000100:00100000:3.0:1788526708.147771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1788526708.147791:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:10536:x1875405868952704:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788526708.168098:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788526708.168259:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788526708.168360:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168414:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168429:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168451:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168459:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168465:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526708.168499:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788526708.168661:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:10536:x1875405868952704:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 20868us (36962us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788526708.168674:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000020:00080000:0.0:1788526708.168681:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788526708.169496:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526708.169509:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.169538:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526708.169543:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.169554:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.169574:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98c243972200) 00010000:00010000:3.0:1788526708.169579:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788526708.169584:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.169591:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.169620:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526708.169623:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526708.169625:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526708.210232:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526708.210474:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953088 00000100:00100000:2.0:1788526708.210488:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953088 00000100:00100000:2.0:1788526708.210574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1788526708.210588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+20:10539:x1875405868953088:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526708.210626:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526708.210656:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3aaea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59595 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210759:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210777:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210794:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210830:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210838:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.210846:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.211177:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.211190:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.211200:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.211946:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.211970:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 21 pid: 6721 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526708.211988:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881551744:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526708.212325:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2433380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526708.220195:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526708.220672:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953344 00000100:00100000:1.0:1788526708.220686:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953344 00000100:00100000:1.0:1788526708.220764:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1788526708.220776:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:5589:x1875405868953344:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788526708.221364:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+23:5589:x1875405868953344:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 588us (1181us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788526708.221373:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1788526708.221607:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b523100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881551744:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526708.221640:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526708.234435:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526708.234533:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953472 00000100:00100000:3.0:1788526708.234546:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953472 00010000:00010000:3.0:1788526708.234603:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 23 pid: 6721 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526708.234650:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1788526708.234661:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+23:2349:x1875405868953472:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526708.234680:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526708.234688:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 23 pid: 6721 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234726:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 23 pid: 6721 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234757:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3aa0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59556 expref: 23 pid: 6721 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234778:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526708.234785:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234796:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234806:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526708.234846:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526708.234937:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:2349:x1875405868953472:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 277us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526708.234946:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00010000:00010000:2.0:1788526708.235088:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235098:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526708.235154:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788526708.235159:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526708.235185:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235200:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235212:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235219:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235239:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235246:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526708.235251:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235260:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235281:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:2.0:1788526708.235295:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526708.235300:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235308:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3aaf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235322:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235329:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235336:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235343:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526708.235346:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235353:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235362:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98c260d60600) 00010000:00010000:2.0:1788526708.235365:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526708.235368:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235374:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3aaf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235473:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3aaea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59595 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235504:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59595 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526708.235512:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:2.0:1788526708.235515:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526708.235517:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76800, rc 0) 00000100:00100000:2.0:1788526708.235553:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+21:10539:x1875405868953088:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 24968us (25365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526708.235561:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00010000:00010000:1.0:1788526708.949246:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526709.140756:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526709.140769:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526709.140810:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788526709.140818:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526709.140973:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e812a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881551872:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788526709.141077:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2484f7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788526709.148776:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e812a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881551872:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788526709.150200:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526709.150435:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953600 00000100:00100000:2.0:1788526709.150445:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953600 00000100:00100000:2.0:1788526709.150524:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:2.0:1788526709.150535:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:10550:x1875405868953600:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788526709.150571:0:5823:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788526709.150684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:10550:x1875405868953600:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 150us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526709.150704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00080000:0.0:1788526709.151176:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526709.163173:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526709.163789:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953856 00000100:00100000:0.0:1788526709.163801:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953856 00000100:00100000:0.0:1788526709.163872:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:0.0:1788526709.163883:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+21:10550:x1875405868953856:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526709.163905:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526709.163928:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ab06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5959c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526709.164310:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ab0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526709.164340:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ab0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526709.164366:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ab0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526709.164380:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788526709.164554:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ab06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5959c expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526709.164573:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ab0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5959c expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526709.164581:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:0.0:1788526709.164584:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526709.164588:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820e00, rc 0) 00000100:00100000:0.0:1788526709.164652:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+23:10550:x1875405868953856:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 771us (1490us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788526709.164660:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:1.0:1788526709.177828:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526709.177936:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868953984 00000100:00100000:3.0:1788526709.177948:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868953984 00000100:00100000:3.0:1788526709.178034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1788526709.178047:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+23:2351:x1875405868953984:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526709.178063:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526709.178102:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ab0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5959c expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.178121:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526709.178127:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526709.178191:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+22:2351:x1875405868953984:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526709.178199:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1788526709.180350:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526709.180493:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868954240 00000100:00100000:1.0:1788526709.180502:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868954240 00000100:00100000:1.0:1788526709.180560:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:1.0:1788526709.180580:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+22:10550:x1875405868954240:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788526709.180668:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180687:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180699:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180948:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180975:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180981:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.180987:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526709.180991:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.181000:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.181014:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526709.181016:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526709.181021:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.181264:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ab1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526709.181460:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:10550:x1875405868954240:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 879us (1119us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788526709.181470:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000040:00080000:1.0:1788526709.181588:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526709.181594:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526709.182100:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788526709.182109:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788526709.186457:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526709.186616:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868954496 00000100:00100000:1.0:1788526709.186628:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868954496 00000100:00100000:1.0:1788526709.186812:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1788526709.186823:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:10550:x1875405868954496:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788526709.187121:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+24:10550:x1875405868954496:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 299us (675us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788526709.187128:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000040:00080000:0.0:1788526709.201679:0:12050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788526709.201689:0:12050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788526709.201753:0:12050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788526709.201760:0:12050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788526709.204566:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881552000:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204644:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204685:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881552512:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204716:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204744:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788526709.204750:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881552128:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204786:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204803:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881552640:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204826:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204869:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881552256:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204892:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204912:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526709.204917:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881552384:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.204938:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.204970:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552000 00000100:00100000:0.0:1788526709.204977:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552000 00000100:00100000:0.0:1788526709.205023:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788526709.205032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881552000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.205086:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881552000:12345-0@lo:400:kworker.0 Request processed in 55us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.205095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788526709.205126:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552512 00000100:00100000:0.0:1788526709.205130:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552512 00000100:00100000:0.0:1788526709.205161:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552128 00000100:00100000:0.0:1788526709.205164:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552128 00000100:00100000:0.0:1788526709.205175:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552256 00000100:00100000:0.0:1788526709.205178:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552256 00000100:00100000:0.0:1788526709.205192:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788526709.205198:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881552512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.205245:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881552512:12345-0@lo:400:kworker.0 Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.205252:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788526709.205265:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788526709.205278:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881552128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.205307:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881552128:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.205313:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788526709.205337:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788526709.205343:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881552256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.205374:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881552256:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.205379:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788526709.205423:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552640 00000100:00100000:0.0:1788526709.205427:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552640 00000100:00100000:0.0:1788526709.205452:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552384 00000100:00100000:0.0:1788526709.205454:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552384 00000100:00100000:0.0:1788526709.205474:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788526709.205480:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881552640:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788526709.208553:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526709.208565:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526709.208569:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526709.210923:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788526709.210948:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881552384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526709.211082:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881552128:0@lo:400:kworker.0 00000100:00100000:3.0:1788526709.211097:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881552000:0@lo:400:kworker.0 00000100:00100000:3.0:1788526709.211110:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881552512:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.213989:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881552640:12345-0@lo:400:kworker.0 Request processed in 8498us (9151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.214008:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788526709.214071:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881552768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526709.214137:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526709.214195:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881552256:0@lo:400:kworker.0 00000100:00100000:3.0:1788526709.214534:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881552640:0@lo:400:kworker.0 00000100:00100000:0.0:1788526709.214712:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552768 00000100:00100000:0.0:1788526709.214719:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552768 00000100:00100000:0.0:1788526709.214768:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788526709.214777:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875405881552768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526709.214805:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788526709.214880:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14401a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875405881552768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526709.214887:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788526709.214924:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881552768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526709.216410:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881552384:12345-0@lo:400:kworker.0 Request processed in 5450us (11446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526709.216422:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788526709.216590:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881552384:0@lo:400:kworker.0 00000100:00100000:3.0:1788526709.525618:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526709.525662:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868954752 00000100:00100000:3.0:1788526709.525674:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868954752 00000100:00100000:3.0:1788526709.525731:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:3.0:1788526709.525742:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+24:10563:x1875405868954752:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526709.525766:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526709.525787:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ab22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595a3 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.527014:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3ab29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.527035:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3ab29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.527048:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3ab29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526709.527060:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788526709.527214:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ab22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595a3 expref: 27 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.527233:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3ab29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595a3 expref: 26 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.527241:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526709.527244:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788526709.527247:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54e00, rc 0) 00000100:00100000:3.0:1788526709.528502:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+26:10563:x1875405868954752:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2754us (2888us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788526709.528513:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:3.0:1788526709.532687:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526709.532735:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868954880 00000100:00100000:3.0:1788526709.532748:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868954880 00000100:00100000:3.0:1788526709.532806:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1788526709.532815:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+26:10563:x1875405868954880:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1788526709.535349:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535374:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535402:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535438:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535444:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535451:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535457:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526709.535462:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535470:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535482:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:3.0:1788526709.535484:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526709.535489:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526709.535495:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ab37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526709.535609:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+26:10563:x1875405868954880:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 2790us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526709.535619:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:2.0:1788526709.670492:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526709.670671:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955008 00000100:00100000:1.0:1788526709.670683:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955008 00000100:00100000:1.0:1788526709.670764:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1788526709.670782:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868955008:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1788526709.670806:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526709.670828:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3ab3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595aa expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788526709.670856:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ac072, atime: 0x6a9ac072, ctime: 0x6a9ac072, blocks: 0xb 00010000:00010000:1.0:1788526709.670883:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788526709.670889:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526709.670917:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3ab3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595aa expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.670940:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3ab3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595aa expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526709.670956:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111a00, rc 0) 00000100:00100000:1.0:1788526709.671025:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2350:x1875405868955008:12345-192.168.204.59@tcp:101:cat.0 Request processed in 251us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526709.671044:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00080000:3.0:1788526709.671490:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526709.688151:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526709.692021:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955136 00000100:00100000:2.0:1788526709.692509:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955136 00002000:00100000:2.0:1788526709.693229:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98c26f9d8a80 x1875405868955136/t0(0) o3->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:425/0 lens 488/0 e 0 to 0 dl 1788526720 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788526709.693243:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26f9d8a80 with x1875405868955136 ext(0->4095) 00002000:00010000:2.0:1788526709.693251:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26f9d8a80 00000100:00100000:3.0:1788526709.693352:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1788526709.693378:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868955136:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:2.0:1788526709.693711:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788526709.693950:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788526709.695975:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868955136:12345-192.168.204.59@tcp:3:cat.0 Request processed in 1468us (6700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788526709.695994:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:3.0:1788526709.696013:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98c26f9d8a80 x1875405868955136/t0(0) o3->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:425/0 lens 488/4536 e 0 to 0 dl 1788526720 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526709.696027:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c26f9d8a80 with x1875405868955136 ext(0->4095) 00002000:00010000:3.0:1788526709.696034:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c26f9d8a80 00010000:00010000:0.0:1788526709.971718:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526710.227678:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881552896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526710.227759:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526710.231461:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881552896 00000100:00100000:0.0:1788526710.231480:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881552896 00000100:00100000:3.0:1788526710.232779:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788526710.232804:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875405881552896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526710.232852:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526710.232954:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875405881552896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526710.232962:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788526710.233247:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881552896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526710.426753:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526710.426787:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526710.426814:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526710.426835:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526710.426856:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526710.426885:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955776 00000100:00100000:2.0:1788526710.426894:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955776 00000100:00100000:2.0:1788526710.426950:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955392 00000100:00100000:2.0:1788526710.426954:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955392 00000100:00100000:2.0:1788526710.426974:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:2.0:1788526710.426983:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868955776:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526710.427050:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868955776:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526710.427056:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:2.0:1788526710.427073:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:2.0:1788526710.427079:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+26:2348:x1875405868955392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526710.427122:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+26:2348:x1875405868955392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526710.427129:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:2.0:1788526710.427152:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955520 00000100:00100000:2.0:1788526710.427155:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955520 00000100:00100000:2.0:1788526710.427195:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955648 00000100:00100000:2.0:1788526710.427199:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955648 00000100:00100000:2.0:1788526710.427217:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:2.0:1788526710.427224:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868955520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526710.427249:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868955520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526710.427255:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:2.0:1788526710.427266:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1788526710.427271:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868955648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526710.427295:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868955648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526710.427300:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00080000:2.0:1788526710.427315:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526710.427320:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526710.427758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955264 00000100:00100000:3.0:1788526710.427763:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955264 00000100:00100000:3.0:1788526710.427805:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 316 00000100:00100000:3.0:1788526710.427811:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868955264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526710.427863:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868955264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 52us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526710.427870:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 316 00010000:00010000:3.0:1788526710.996556:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526712.019825:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788526712.892186:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788526712.940772:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1788526712.940807:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788526712.940832:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788526712.940852:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788526712.940865:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c2742d2240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788526712.940870:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274b88b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c2742d2d80 00000020:00080000:2.0:1788526712.940873:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274b88f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c27bbc8c00 00000020:00080000:0.0:1788526712.940974:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788526712.941210:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788526713.044121:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526713.387344:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788526713.387371:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1788526714.067500:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526714.325074:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526714.325084:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526714.325244:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788526714.325251:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526714.327236:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881553024:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.327412:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526714.327549:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526714.327556:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881553152:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.327587:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526714.327625:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553152 00000100:00100000:1.0:1788526714.327633:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553152 00000100:00100000:1.0:1788526714.327688:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788526714.327698:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.327753:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881553152:12345-0@lo:400:kworker.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526714.327769:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788526714.327816:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881553152:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.334641:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881553280:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.334725:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526714.334844:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553280 00000100:00100000:0.0:1788526714.334853:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553280 00000100:00100000:0.0:1788526714.334919:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788526714.334929:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881553280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526714.337739:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881553280:12345-0@lo:400:kworker.0 Request processed in 2804us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526714.337756:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788526714.337798:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526714.337810:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553024 00000100:00100000:3.0:1788526714.337827:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553024 00000100:00100000:3.0:1788526714.337877:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788526714.337885:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881553024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.337949:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881553024:12345-0@lo:400:kworker.0 Request processed in 65us (10538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526714.337955:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788526714.337990:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.338020:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526714.338046:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526714.338051:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881553792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526714.338072:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526714.338096:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881553664:0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.338129:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526714.338160:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526714.338166:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881553536:0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.338189:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526714.338215:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553408 00000100:00100000:3.0:1788526714.338218:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553408 00000100:00100000:3.0:1788526714.338260:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553664 00000100:00100000:3.0:1788526714.338272:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553664 00000100:00100000:3.0:1788526714.338298:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788526714.338305:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.338339:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881553408:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526714.338345:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788526714.338357:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788526714.338362:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881553664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.338414:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881553664:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526714.338422:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788526714.338439:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553792 00000100:00100000:3.0:1788526714.338442:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553792 00000100:00100000:3.0:1788526714.338466:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788526714.338472:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881553792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526714.338502:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526714.338531:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881553792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526714.338536:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788526714.338556:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526714.338559:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526714.338580:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788526714.338585:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c26e813480, transno 4294967310 00000004:00080000:3.0:1788526714.338594:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788526714.338619:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881553792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526714.338629:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788526714.338632:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c27b523480, transno 4294967304 00000100:00100000:3.0:1788526714.338650:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788526714.339132:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881553664:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.340755:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881553280:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.340800:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553536 00000100:00100000:1.0:1788526714.340807:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553536 00000100:00080000:0.0:1788526714.340908:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526714.340943:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788526714.340953:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881553536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.341055:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881553536:12345-0@lo:400:kworker.0 Request processed in 103us (2864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526714.341062:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788526714.341133:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881553536:0@lo:400:kworker.0 00000100:00100000:1.0:1788526714.341315:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26f9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881553024:0@lo:400:kworker.0 00010000:00010000:3.0:1788526715.092366:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526715.213207:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526715.213307:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868955904 00000100:00100000:0.0:1788526715.213319:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868955904 00000100:00100000:0.0:1788526715.213431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:0.0:1788526715.213443:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:10223:x1875405868955904:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788526715.213728:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526715.213870:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:10223:x1875405868955904:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 428us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526715.213893:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:2.0:1788526715.226835:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526715.227106:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956160 00000100:00100000:3.0:1788526715.227120:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956160 00000100:00100000:3.0:1788526715.227551:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1788526715.227566:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:10223:x1875405868956160:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788526715.228500:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+14:10223:x1875405868956160:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 930us (1675us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788526715.228511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:1.0:1788526715.348131:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526715.348176:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881553920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526715.348271:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526715.348881:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881553920 00000100:00100000:0.0:1788526715.348894:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881553920 00000100:00100000:0.0:1788526715.348968:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788526715.348981:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881553920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526715.349031:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526715.349117:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881553920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526715.349125:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788526715.349464:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881553920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526715.552376:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526715.552663:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526715.552711:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526715.552763:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526715.552831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956288 00000100:00100000:0.0:1788526715.552846:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956288 00000100:00100000:0.0:1788526715.552914:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 318 00000100:00100000:0.0:1788526715.552937:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868956288:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526715.553034:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868956288:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526715.553043:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 318 00000100:00100000:3.0:1788526715.556761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956672 00000100:00100000:3.0:1788526715.556783:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956672 00000100:00100000:3.0:1788526715.556915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:3.0:1788526715.556938:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868956672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526715.557053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2348:x1875405868956672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 127us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526715.557062:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00080000:0.0:1788526715.563797:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526715.570545:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526715.570867:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956800 00000100:00100000:0.0:1788526715.570883:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956800 00000100:00100000:0.0:1788526715.570975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:0.0:1788526715.570991:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:11018:x1875405868956800:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:0.0:1788526715.571024:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526715.571055:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595b1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571170:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571206:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571220:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526715.571269:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526715.571273:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526715.571332:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571364:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571472:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526715.571483:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526715.571487:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526715.571491:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820000, rc 0) 00000100:00100000:0.0:1788526715.571573:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:11018:x1875405868956800:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 587us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526715.571581:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:2.0:1788526715.573575:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956416 00000100:00100000:2.0:1788526715.573592:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956416 00000100:00080000:0.0:1788526715.573825:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526715.578874:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956544 00000100:00100000:3.0:1788526715.578899:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956544 00000100:00100000:3.0:1788526715.579038:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1788526715.579053:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868956416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526715.579194:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868956416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 146us (26841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526715.579202:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1788526715.579445:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1788526715.579455:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868956544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526715.579493:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868956544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (26730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526715.579500:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00080000:0.0:1788526715.584459:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788526716.116922:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526717.142883:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788526717.980119:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788526717.980229:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788526717.980414:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788526717.980430:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788526718.164019:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526719.187631:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526719.446295:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881554048:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446422:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446482:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881554560:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446513:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446546:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788526719.446553:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881554176:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446578:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446598:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881554688:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446626:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446662:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881554304:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446688:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446709:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526719.446715:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881554432:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446737:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.446785:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554048 00000100:00100000:0.0:1788526719.446794:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554048 00000100:00100000:0.0:1788526719.446850:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788526719.446860:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881554048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.446933:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2498d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881554048:12345-0@lo:400:kworker.0 Request processed in 74us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.446941:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788526719.446980:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554560 00000100:00100000:0.0:1788526719.446984:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554560 00000100:00100000:0.0:1788526719.447035:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554176 00000100:00100000:0.0:1788526719.447039:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554176 00000100:00100000:0.0:1788526719.447053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554304 00000100:00100000:0.0:1788526719.447056:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554304 00000100:00100000:0.0:1788526719.447088:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788526719.447095:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881554560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447129:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881554560:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.447135:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788526719.447149:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788526719.447155:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881554176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447181:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881554176:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.447186:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788526719.447198:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788526719.447204:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881554304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447234:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881554304:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.447240:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788526719.447262:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554688 00000100:00100000:0.0:1788526719.447265:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554688 00000100:00100000:0.0:1788526719.447292:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554432 00000100:00100000:0.0:1788526719.447295:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554432 00000100:00100000:0.0:1788526719.447313:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788526719.447319:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881554688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447347:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881554688:12345-0@lo:400:kworker.0 Request processed in 28us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.447352:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788526719.447361:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788526719.447367:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881554432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447434:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881554432:12345-0@lo:400:kworker.0 Request processed in 67us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.447441:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788526719.447468:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526719.447473:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526719.447475:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526719.447518:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881554432:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447531:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881554304:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447568:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881554176:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447578:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881554688:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447586:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881554048:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.447595:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881554560:0@lo:400:kworker.0 00000100:00100000:0.0:1788526719.454924:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788526719.454957:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881554816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526719.455070:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526719.455142:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554816 00000100:00100000:0.0:1788526719.455153:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554816 00000100:00100000:0.0:1788526719.455225:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788526719.455235:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881554816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526719.455285:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526719.455340:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881554816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526719.455348:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788526719.455440:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881554816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788526720.212802:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788526720.214860:0:12252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:58:37 (1788526717) 00000100:00100000:3.0:1788526720.467793:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881554944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526720.467904:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526720.468122:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881554944 00000100:00100000:0.0:1788526720.468133:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881554944 00000100:00100000:0.0:1788526720.468203:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788526720.468214:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881554944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526720.468265:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526720.468338:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881554944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526720.468346:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788526720.468451:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881554944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526720.673018:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526720.673069:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526720.673109:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526720.673142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526720.673172:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526720.673205:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957440 00000100:00100000:0.0:1788526720.673218:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957440 00000100:00100000:0.0:1788526720.673287:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957056 00000100:00100000:0.0:1788526720.673291:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957056 00000100:00100000:0.0:1788526720.673314:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1788526720.673325:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2349:x1875405868957440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526720.673460:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2349:x1875405868957440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 135us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526720.673469:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1788526720.673489:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:0.0:1788526720.673496:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868957056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526720.673782:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868956928 00000100:00100000:3.0:1788526720.673787:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868956928 00000100:00100000:3.0:1788526720.673822:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:3.0:1788526720.673829:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868956928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526720.673862:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2349:x1875405868956928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526720.673868:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:2.0:1788526720.674111:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957184 00000100:00100000:2.0:1788526720.674116:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957184 00000100:00100000:2.0:1788526720.674162:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957312 00000100:00100000:2.0:1788526720.674165:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957312 00000100:00100000:2.0:1788526720.674186:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:2.0:1788526720.674193:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868957184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526720.674231:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+5:2349:x1875405868957184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526720.674238:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:2.0:1788526720.674250:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:2.0:1788526720.674256:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868957312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526720.674280:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868957312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526720.674286:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:0.0:1788526720.674651:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868957056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1152us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526720.674684:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00080000:0.0:1788526720.674726:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788526720.674732:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526720.674735:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788526721.236431:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526721.816890:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526721.816971:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957696 00000100:00100000:2.0:1788526721.816982:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957696 00000100:00100000:2.0:1788526721.817055:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:2.0:1788526721.817066:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:11284:x1875405868957696:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526721.817090:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526721.817113:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3ab53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595b8 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817232:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817246:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817260:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817275:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817282:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817289:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817624:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817634:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817640:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526721.817649:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788526721.817810:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817818:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817830:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817836:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526721.817841:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817848:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817860:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284500) 00010000:00010000:2.0:1788526721.817863:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526721.817868:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817874:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ab5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817886:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817892:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817897:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817903:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526721.817906:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817920:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817927:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c260d60300) 00010000:00010000:2.0:1788526721.817929:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526721.817932:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.817938:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ab61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.818307:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3ab53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b8 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.818323:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b8 expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526721.818330:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:2.0:1788526721.818332:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526721.818335:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77c00, rc 0) 00000100:00100000:2.0:1788526721.819406:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+15:11284:x1875405868957696:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 2323us (2508us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788526721.819417:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:1.0:1788526721.826834:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526721.827068:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957824 00000100:00100000:0.0:1788526721.827081:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957824 00000100:00100000:0.0:1788526721.827159:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:0.0:1788526721.827170:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+15:11284:x1875405868957824:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788526721.827304:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+15:11284:x1875405868957824:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 135us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526721.827313:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:3.0:1788526721.833098:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526721.835849:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868957952 00000100:00100000:1.0:1788526721.835864:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868957952 00000100:00100000:1.0:1788526721.836511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526721.836524:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:2350:x1875405868957952:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526721.836542:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526721.836567:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b8 expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526721.836589:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:1.0:1788526721.836595:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526721.836721:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+14:2350:x1875405868957952:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 199us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526721.836729:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:0.0:1788526722.259553:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526722.515603:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526722.515612:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526722.516145:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788526722.516154:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788526723.126782:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788526723.283593:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526724.125247:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526724.125438:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958080 00000100:00100000:0.0:1788526724.125450:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958080 00000100:00100000:0.0:1788526724.125535:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:0.0:1788526724.125548:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:11326:x1875405868958080:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526724.125569:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526724.125589:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595bf expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125672:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125687:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125700:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125725:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125732:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125738:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125944:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125952:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125958:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125963:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526724.125968:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125975:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.125988:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526724.125991:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526724.125996:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126002:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ab7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126019:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126026:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126030:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126036:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526724.126039:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126044:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126052:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98c243972600) 00010000:00010000:0.0:1788526724.126054:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526724.126057:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126063:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126094:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595bf expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126104:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526724.126107:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526724.126117:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595bf expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.126126:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820600, rc 0) 00000100:00100000:0.0:1788526724.126206:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:11326:x1875405868958080:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 662us (971us total) trans 0 rc 301/301 00000100:00100000:0.0:1788526724.126213:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00080000:1.0:1788526724.126567:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526724.154270:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526724.154842:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958336 00000100:00100000:2.0:1788526724.154854:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958336 00000100:00100000:2.0:1788526724.154929:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:2.0:1788526724.154941:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:11326:x1875405868958336:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:2.0:1788526724.155020:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526724.155048:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3a4f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593f8 expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.155068:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:2.0:1788526724.155074:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526724.161269:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.161300:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.161311:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.161361:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.161378:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 5 pid: 5823 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.161435:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881555072:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526724.161922:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2484f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526724.170065:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881555072:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526724.170098:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526724.172614:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.173043:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958464 00000100:00100000:3.0:1788526724.173069:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958464 00010000:00010000:3.0:1788526724.173128:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 6 pid: 5823 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526724.173167:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1788526724.173180:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2349:x1875405868958464:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526724.173198:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526724.173208:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 6 pid: 5823 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173225:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 6 pid: 5823 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173251:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ab4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595b1 expref: 6 pid: 5823 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173267:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526724.173274:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173285:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173292:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.173328:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788526724.173376:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526724.173409:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2349:x1875405868958464:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 209us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.173427:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00010000:00010000:0.0:1788526724.174366:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.174379:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.174545:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.174558:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.174579:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526724.179317:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788526724.179340:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181876:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181886:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181910:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526724.181926:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181938:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181959:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526724.181962:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526724.181968:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526724.181975:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77c00/0x367645d450b3ab8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526724.182015:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093591ed0 reply state 0000000058627ebb transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526724.182025:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526724.183236:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+14:11326:x1875405868958336:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 28287us (28966us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788526724.183248:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00010000:00010000:2.0:1788526724.203882:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203901:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203934:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203940:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526724.203946:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203954:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203971:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98c243972600) 00010000:00010000:2.0:1788526724.203974:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526724.203979:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.203985:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ab92 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.313509:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526724.321499:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526724.324692:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958592 00000100:00100000:0.0:1788526724.325364:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958592 00000100:00100000:0.0:1788526724.325547:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:0.0:1788526724.325559:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+13:11334:x1875405868958592:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:0.0:1788526724.325597:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526724.325623:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595c6 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.325967:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.325983:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.325997:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.326033:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788526724.326037:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526724.326061:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.326087:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3ab99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595c6 expref: 15 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.326106:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595c6 expref: 14 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.326115:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526724.326118:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788526724.326122:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55600, rc 0) 00000100:00100000:3.0:1788526724.326301:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+14:11334:x1875405868958592:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 743us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.326308:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:2.0:1788526724.401247:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.403524:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958720 00000100:00100000:3.0:1788526724.403572:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958720 00000100:00100000:3.0:1788526724.403641:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:3.0:1788526724.403652:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+14:11340:x1875405868958720:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526724.403675:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.403698:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3aba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595cd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403769:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403785:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403797:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403970:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403982:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.403990:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404235:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404245:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404253:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.404295:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788526724.404300:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526724.404323:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404336:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404343:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404351:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404357:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.404363:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404371:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404427:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526724.404431:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.404436:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404443:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3abae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404458:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404475:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404481:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404486:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.404490:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404497:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404506:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98c242a8b300) 00010000:00010000:3.0:1788526724.404509:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.404512:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404519:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3abb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404553:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3aba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595cd expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404568:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595cd expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.404576:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526724.404578:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788526724.404587:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55a00, rc 0) 00000100:00100000:3.0:1788526724.404742:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+15:11340:x1875405868958720:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1090us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.404750:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:0.0:1788526724.417775:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526724.418273:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868958976 00000100:00100000:2.0:1788526724.418284:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868958976 00000100:00100000:2.0:1788526724.418603:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:2.0:1788526724.418616:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+15:11340:x1875405868958976:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526724.418641:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526724.418666:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3abc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595d4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.418815:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.418990:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419006:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419038:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419047:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419054:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526724.419705:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788526724.419893:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419905:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419925:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419961:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419967:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419974:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.419987:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526724.419992:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.420000:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.420014:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526724.420016:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526724.420021:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.420028:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3abca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526724.420041:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075cb0444 reply state 00000000fb6daff3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.420050:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788526724.420083:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3abc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.420098:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.420106:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526724.420108:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526724.420110:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76400, rc 0) 00000100:00100000:2.0:1788526724.420200:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:11340:x1875405868958976:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1587us (2436us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788526724.420215:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00010000:00010000:3.0:1788526724.423425:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423445:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423452:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423457:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.423462:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423470:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423487:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c260d60300) 00010000:00010000:3.0:1788526724.423490:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.423495:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.423502:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3abd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526724.428247:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526724.430846:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868959104 00000100:00100000:1.0:1788526724.430865:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868959104 00000100:00100000:1.0:1788526724.430974:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1788526724.430999:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868959104:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1788526724.431020:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526724.431042:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595db expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788526724.431073:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526724.431099:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1788526724.431116:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526724.431126:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.431146:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 6 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.431162:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111200, rc 0) 00000100:00100000:1.0:1788526724.431242:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2351:x1875405868959104:12345-192.168.204.59@tcp:101:bash.0 Request processed in 246us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526724.431250:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00080000:0.0:1788526724.431380:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526724.437103:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526724.437263:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868959232 00000100:00100000:2.0:1788526724.437277:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868959232 00000100:00100000:2.0:1788526724.437378:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1788526724.437418:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+6:11340:x1875405868959232:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526724.437437:0:12011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526724.437457:0:12011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595e2 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.437491:0:12011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.437500:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526724.437505:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526724.437510:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 7 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.437546:0:12011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.437576:0:12011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.437590:0:12011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12011:1875405881555200:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526724.437695:0:12011:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2484f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788526724.448408:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526724.448579:0:12011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12011:1875405881555200:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526724.448620:0:12011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 7 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.448646:0:12011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76200, rc 0) 00000100:00100000:2.0:1788526724.448708:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+7:11340:x1875405868959232:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11320us (11615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526724.448718:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1788526724.454273:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868959360 00000100:00100000:3.0:1788526724.454295:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868959360 00010000:00010000:2.0:1788526724.454503:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526724.454793:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1788526724.455673:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868959360:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526724.455696:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526724.455728:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.455748:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.455774:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3abe6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595db expref: 7 pid: 6669 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.455793:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526724.455798:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526724.455808:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.455985:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.456031:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.456047:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881555328:192.168.204.59@tcp:105: 00000100:00100000:2.0:1788526724.456222:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2484f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788526724.468584:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881555328:192.168.204.59@tcp:105: 00010000:00010000:2.0:1788526724.468619:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526724.468676:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868959360:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 13541us (20292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526724.468689:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1788526724.475607:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.475710:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868959616 00000100:00100000:3.0:1788526724.475734:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868959616 00000100:00100000:3.0:1788526724.475809:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1788526724.476066:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+17:11340:x1875405868959616:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1788526724.476584:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:11340:x1875405868959616:12345-192.168.204.59@tcp:35:bash.0 Request processed in 763us (987us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788526724.476594:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1788526724.563633:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526724.563658:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881555456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526724.563732:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526724.563927:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881555456 00000100:00100000:0.0:1788526724.563937:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881555456 00000100:00100000:0.0:1788526724.564017:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788526724.564247:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881555712:0@lo:400:kworker.0 00000040:00080000:1.0:1788526724.564260:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526724.564266:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788526724.564298:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526724.564324:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526724.564330:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881555840:0@lo:400:kworker.0 00000100:00100000:3.0:1788526724.564354:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526724.564409:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881555712 00000100:00100000:3.0:1788526724.564413:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881555712 00000100:00100000:3.0:1788526724.564443:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881555840 00000100:00100000:3.0:1788526724.564447:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881555840 00000100:00100000:3.0:1788526724.564470:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788526724.564479:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526724.564537:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881555712:12345-0@lo:400:kworker.0 Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.564545:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788526724.564585:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000040:00080000:1.0:1788526724.564586:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000100:00100000:3.0:1788526724.564597:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881555840:12345-0@lo:400:kworker.0 00000040:00080000:1.0:1788526724.564597:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788526724.564633:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881555840:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.564639:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1788526724.564679:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526724.564682:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881555840:0@lo:400:kworker.0 00000100:00080000:1.0:1788526724.564685:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526724.564712:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881555712:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.564720:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881555584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.564764:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526724.564793:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881556096:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.564838:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526724.564859:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526724.564866:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881555968:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.564892:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526724.564934:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881555968 00000100:00100000:1.0:1788526724.564938:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881555968 00000100:00100000:1.0:1788526724.564974:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788526724.564981:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881555968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.565018:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881555968:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526724.565038:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788526724.565052:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526724.565059:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881556096 00000100:00100000:1.0:1788526724.565062:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881556096 00000100:00100000:1.0:1788526724.565085:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788526724.565091:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881556096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.565119:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875405881556096:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526724.565124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1788526724.565136:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526724.565153:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881555968:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.565162:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881556096:0@lo:400:kworker.0 00000100:00100000:0.0:1788526724.565533:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881555456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526724.565566:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526724.565610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881555456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526724.565617:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788526724.565650:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881555584 00000100:00100000:3.0:1788526724.565655:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881555584 00000100:00100000:3.0:1788526724.565692:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788526724.565699:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526724.565737:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881555584:12345-0@lo:400:kworker.0 Request processed in 39us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.565744:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788526724.570057:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881555584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526724.573256:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881555456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526724.617526:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.617647:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868959872 00000100:00100000:3.0:1788526724.617658:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868959872 00000100:00100000:3.0:1788526724.617733:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:3.0:1788526724.617743:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+18:11350:x1875405868959872:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526724.617768:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.617787:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3abf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595e9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.617914:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788526724.618074:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3abf4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e9 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.618091:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526724.618106:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526724.618113:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3abf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e9 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.618129:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526724.618655:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+19:11350:x1875405868959872:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 910us (1135us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788526724.618664:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:0.0:1788526724.632496:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.632586:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868960128 00000100:00100000:3.0:1788526724.632598:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868960128 00000100:00100000:3.0:1788526724.632647:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1788526724.632656:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:11350:x1875405868960128:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526724.632924:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+20:11350:x1875405868960128:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 268us (439us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788526724.632932:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1788526724.759718:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.759822:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868960256 00000100:00100000:3.0:1788526724.759832:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868960256 00000100:00100000:3.0:1788526724.759931:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:3.0:1788526724.759942:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+20:11356:x1875405868960256:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526724.759969:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.759994:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595f0 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760066:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760079:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760093:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.760129:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788526724.760147:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526724.760169:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760197:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f0 expref: 22 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760217:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f0 expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.760226:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526724.760230:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788526724.760233:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54800, rc 0) 00000100:00100000:3.0:1788526724.760302:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+21:11356:x1875405868960256:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 362us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.760309:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:0.0:1788526724.775448:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526724.775961:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868960512 00000100:00100000:1.0:1788526724.775972:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868960512 00000100:00100000:1.0:1788526724.776046:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:1.0:1788526724.776057:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+21:11356:x1875405868960512:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526724.776078:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526724.776100:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ac10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595f7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.776208:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3ac17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.776223:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3ac17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.776235:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3ac17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526724.776246:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788526724.776420:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ac10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f7 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.776440:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3ac17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f7 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.776448:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:1.0:1788526724.776451:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526724.776455:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110800, rc 0) 00000100:00100000:1.0:1788526724.776535:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+23:11356:x1875405868960512:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 480us (1096us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788526724.776543:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:0.0:1788526724.782168:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.782292:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868960896 00000100:00100000:3.0:1788526724.782308:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868960896 00000100:00100000:3.0:1788526724.782456:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526724.782469:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:2351:x1875405868960896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526724.782494:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526724.782531:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3ac17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f7 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.782576:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:3.0:1788526724.782584:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526724.782672:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+22:2351:x1875405868960896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 205us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.782705:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1788526724.787323:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.787527:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868960768 00000100:00100000:3.0:1788526724.787543:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868960768 00000100:00100000:3.0:1788526724.787626:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:3.0:1788526724.787638:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+22:11356:x1875405868960768:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526724.787677:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.787709:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc595fe expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.787853:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.787873:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.787889:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.787916:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788526724.788110:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595fe expref: 25 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.788131:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595fe expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.788141:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:3.0:1788526724.788144:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788526724.788148:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:3.0:1788526724.788236:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+24:11356:x1875405868960768:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 599us (930us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788526724.788245:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:0.0:1788526724.795685:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.795921:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961024 00000100:00100000:3.0:1788526724.795936:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961024 00000100:00100000:3.0:1788526724.796035:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1788526724.796047:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868961024:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:3.0:1788526724.796125:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.796152:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.796164:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788526724.796169:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526724.796174:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.796223:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.796240:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 6 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526724.796256:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881556224:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526724.796382:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526724.801731:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881556224:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526724.801783:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526724.802147:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.802220:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961152 00000100:00100000:3.0:1788526724.802228:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961152 00002000:00100000:3.0:1788526724.802296:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98c2746c2300 x1875405868961152/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:440/0 lens 504/0 e 0 to 0 dl 1788526735 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526724.802307:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c2746c2300 with x1875405868961152 ext(0->12) 00010000:00010000:3.0:1788526724.802316:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 7 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.802333:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 7 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526724.802341:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c2746c2300 00000100:00100000:3.0:1788526724.802422:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1788526724.802434:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868961152:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:3.0:1788526724.803184:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868961152:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 748us (1035us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788526724.803194:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:3.0:1788526724.803204:0:6676:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98c2746c2300 x1875405868961152/t4294967305(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:440/0 lens 504/448 e 0 to 0 dl 1788526735 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526724.803214:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c2746c2300 with x1875405868961152 ext(0->12) 00010000:00010000:3.0:1788526724.803221:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.803243:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526724.803252:0:6676:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c2746c2300 00000100:00100000:0.0:1788526724.806376:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526724.806733:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961280 00000100:00100000:2.0:1788526724.806746:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961280 00010000:00010000:2.0:1788526724.806803:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.806924:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1788526724.806935:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:2348:x1875405868961280:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526724.806956:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788526724.806982:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788526724.806985:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788526723 00002000:00010000:2.0:1788526724.806988:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788526724 00002000:00010000:2.0:1788526724.807009:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788526723 00010000:00010000:2.0:1788526724.807193:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.807211:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.807248:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000775e6253/0x367645d450b3abed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595e2 expref: 9 pid: 12011 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.807270:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788526724.807275:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788526724.807282:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.807295:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.807376:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526724.807502:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868961280:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 567us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526724.807511:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00010000:00010000:3.0:1788526724.809126:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.809150:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809339:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809350:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809484:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809492:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526724.809498:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809508:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809533:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.809540:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073eb4ab7/0x367645d450b3ac3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.809803:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868961024:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 13749us (14247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526724.809815:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:0.0:1788526724.813994:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.814164:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961536 00000100:00100000:3.0:1788526724.814179:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961536 00000100:00100000:3.0:1788526724.814289:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1788526724.814304:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+24:11356:x1875405868961536:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:3.0:1788526724.814435:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595fe expref: 24 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526724.814782:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788526724.815939:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788526724.817322:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788526724.817953:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.817981:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.818005:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.818213:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.818233:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 28 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.818251:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881556352:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526724.818534:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788526724.822487:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526724.822689:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961664 00000100:00100000:1.0:1788526724.822702:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961664 00010000:00010000:1.0:1788526724.822761:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 29 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526724.822805:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:1.0:1788526724.822824:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+29:2348:x1875405868961664:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526724.822849:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526724.822857:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 29 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.822873:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 29 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.822911:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:1.0:1788526724.822917:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.822930:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.822939:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526724.822965:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526724.823055:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+29:2348:x1875405868961664:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 241us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526724.823071:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00010000:00010000:2.0:1788526724.823443:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3abd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595d4 expref: 28 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.823468:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881556352:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526724.823497:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.823507:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.823514:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526724.823720:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788526724.823994:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788526724.825782:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881556480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788526724.825958:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526724.826058:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2484f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526724.826220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881556480 00000100:00100000:0.0:1788526724.826231:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881556480 00000100:00100000:0.0:1788526724.826337:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788526724.826348:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881556480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788526724.826726:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881556480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 379us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526724.826734:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526724.826806:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881556480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788526724.827951:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788526724.828135:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881556608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788526724.828218:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526724.828321:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788526724.828368:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881556608 00000100:00100000:1.0:1788526724.828377:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881556608 00000100:00100000:1.0:1788526724.828642:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788526724.828654:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881556608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788526724.828915:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5825:x1875405881556608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 263us (696us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788526724.828924:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788526724.829038:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881556608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788526724.829116:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788526724.829177:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829192:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829202:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829211:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526724.829217:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829226:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829249:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526724.829253:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788526724.829259:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526724.829284:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ac41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526724.829879:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788526724.830056:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788526724.830073:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360170685881ns, next at 361170682522ns, rc = 0 00000001:00080000:2.0:1788526724.830083:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788526724.830134:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526724.830138:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788526724.830149:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595fe expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526724.830321:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+31:11356:x1875405868961536:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 16019us (16341us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788526724.830331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000020:00080000:2.0:1788526724.830337:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788526724.834371:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.834600:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868961792 00000100:00100000:3.0:1788526724.834616:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868961792 00000100:00100000:3.0:1788526724.834707:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:3.0:1788526724.834720:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+31:11356:x1875405868961792:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526724.834754:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.834784:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59605 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.834920:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59605 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.834939:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59605 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.834961:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526724.834965:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526724.834969:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55200, rc 0) 00000100:00100000:3.0:1788526724.835044:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+32:11356:x1875405868961792:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 326us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.835051:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:3.0:1788526724.840962:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526724.841336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868962048 00000100:00100000:1.0:1788526724.841353:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868962048 00000100:00100000:1.0:1788526724.841464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1788526724.841477:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+32:11356:x1875405868962048:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526724.841856:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+33:11356:x1875405868962048:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 381us (910us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788526724.841865:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1788526724.942308:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.942493:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868962304 00000100:00100000:3.0:1788526724.942508:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868962304 00000100:00100000:3.0:1788526724.942705:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:3.0:1788526724.942719:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+33:11367:x1875405868962304:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526724.942755:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526724.942786:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5960c expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526724.942934:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788526724.943114:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5960c expref: 35 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.943134:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526724.943156:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526724.943163:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54000/0x367645d450b3ac4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5960c expref: 35 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.943182:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b54000, rc 0) 00000100:00100000:3.0:1788526724.943269:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+34:11367:x1875405868962304:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 553us (977us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788526724.943277:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:0.0:1788526724.947633:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526724.947758:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868962432 00000100:00100000:3.0:1788526724.947772:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868962432 00000100:00100000:3.0:1788526724.947852:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:3.0:1788526724.947864:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+34:11367:x1875405868962432:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1788526724.947986:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948007:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948039:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948088:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948096:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948104:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948220:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948235:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948243:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526724.948299:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948316:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948324:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948332:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948339:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.948344:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948353:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.948367:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526724.948370:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.948376:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949243:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54600/0x367645d450b3ac5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949282:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949289:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949296:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949301:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.949305:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949312:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949323:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8bc00) 00010000:00010000:3.0:1788526724.949327:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.949330:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949337:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3ac64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949354:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949361:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949367:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949379:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526724.949623:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949632:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949642:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526724.949644:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526724.949647:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526724.949652:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526724.949781:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+34:11367:x1875405868962432:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1915us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526724.949792:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1788526724.953720:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526724.953891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868962688 00000100:00100000:1.0:1788526724.953916:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868962688 00000100:00100000:1.0:1788526724.954173:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1788526724.954187:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+34:11367:x1875405868962688:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526724.954793:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:11367:x1875405868962688:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 606us (1089us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788526724.954803:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:2.0:1788526725.011585:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526725.012060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868962944 00000100:00100000:0.0:1788526725.012076:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868962944 00000100:00100000:0.0:1788526725.012165:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1788526725.012178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:11370:x1875405868962944:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526725.012213:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526725.012243:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ac72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59613 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012354:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012375:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012428:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012446:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012474:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012482:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012644:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012655:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012663:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526725.012676:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788526725.012804:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012813:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012822:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012828:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526725.012835:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012844:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.012870:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526725.012874:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526725.012880:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013116:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3ac79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013136:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013142:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013147:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013152:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526725.013155:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013161:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013170:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c243972900) 00010000:00010000:0.0:1788526725.013172:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526725.013175:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013180:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ac80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013248:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ac72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013263:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.013270:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526725.013272:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526725.013274:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820600, rc 0) 00000100:00100000:0.0:1788526725.013604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+37:11370:x1875405868962944:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1425us (2033us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788526725.013616:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1788526725.031600:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.031886:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868963072 00000100:00100000:3.0:1788526725.031910:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868963072 00000100:00100000:3.0:1788526725.031995:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:3.0:1788526725.032007:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+37:11370:x1875405868963072:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1788526725.032117:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032140:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032155:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032211:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032219:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032227:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032234:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526725.032239:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032248:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032263:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526725.032267:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526725.032276:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.032282:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.032451:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+37:11370:x1875405868963072:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 379us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526725.032462:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:1.0:1788526725.036656:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.036814:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868963328 00000100:00100000:3.0:1788526725.036828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868963328 00000100:00100000:3.0:1788526725.036911:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1788526725.036945:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+37:11370:x1875405868963328:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526725.037274:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+38:11370:x1875405868963328:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 331us (634us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788526725.037283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00010000:00010000:1.0:1788526725.335654:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526725.398009:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.400027:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868963584 00000100:00100000:3.0:1788526725.400043:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868963584 00000100:00100000:3.0:1788526725.400197:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:3.0:1788526725.400210:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+38:11401:x1875405868963584:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:3.0:1788526725.400238:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526725.400262:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5961a expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.400365:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3aca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.400380:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3aca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.400420:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3aca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526725.400432:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788526725.400581:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3ac9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5961a expref: 41 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.400601:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3aca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5961a expref: 40 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.400627:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526725.400630:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526725.400634:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6c00, rc 0) 00000100:00100000:3.0:1788526725.400702:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+40:11401:x1875405868963584:12345-192.168.204.59@tcp:101:cat.0 Request processed in 493us (2705us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788526725.400709:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1788526725.409045:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526725.409478:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.409718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868963968 00000100:00100000:3.0:1788526725.409729:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868963968 00000100:00100000:3.0:1788526725.409789:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:3.0:1788526725.409800:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+40:11401:x1875405868963968:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:3.0:1788526725.410120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+41:11401:x1875405868963968:12345-192.168.204.59@tcp:35:cat.0 Request processed in 320us (642us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788526725.410129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1788526725.410270:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868963712 00000100:00100000:2.0:1788526725.410275:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868963712 00000100:00100000:2.0:1788526725.410320:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1788526725.410328:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+41:2348:x1875405868963712:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526725.410338:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526725.410361:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3aca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5961a expref: 41 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.410379:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526725.410419:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526725.410441:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+40:2348:x1875405868963712:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 114us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526725.410447:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526725.469282:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.469369:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964224 00000100:00100000:3.0:1788526725.469381:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964224 00000100:00100000:3.0:1788526725.469477:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:3.0:1788526725.469487:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+40:11407:x1875405868964224:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1788526725.469515:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526725.469519:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788526725.469668:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54800/0x367645d450b3ac09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595f0 expref: 40 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.469689:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526725.469694:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526725.469708:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3acb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59621 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.469990:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.470006:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.470016:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.470051:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.470066:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 40 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.470079:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881556736:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526725.470196:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526725.474716:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881556736:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526725.474817:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526725.480184:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.483636:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964352 00000100:00100000:3.0:1788526725.483650:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964352 00010000:00010000:3.0:1788526725.483698:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 41 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.483743:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:3.0:1788526725.483771:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+41:2348:x1875405868964352:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526725.483786:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526725.483793:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 41 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483806:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 41 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483827:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3ac87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59613 expref: 41 pid: 5823 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483843:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526725.483848:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483858:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483866:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.483917:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526725.483978:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+40:2348:x1875405868964352:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 209us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526725.483986:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00010000:00010000:0.0:1788526725.484182:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.484191:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526725.484211:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788526725.484439:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3acb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.484470:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526725.484478:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526725.484480:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788526725.484482:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6800, rc 0) 00000100:00100000:0.0:1788526725.484514:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+40:11407:x1875405868964224:12345-192.168.204.59@tcp:101:dd.0 Request processed in 15029us (15241us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788526725.484521:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:0.0:1788526725.496047:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526725.502017:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964608 00000100:00100000:2.0:1788526725.502034:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964608 00000100:00100000:2.0:1788526725.502167:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:2.0:1788526725.502178:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+40:11407:x1875405868964608:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:2.0:1788526725.502512:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.502537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.502550:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526725.502606:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788526725.502636:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a95a57b8 reply state 0000000043dc71c0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526725.502645:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526725.504025:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+43:11407:x1875405868964608:12345-192.168.204.59@tcp:36:dd.0 Request processed in 1839us (7979us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788526725.504035:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00000020:00080000:2.0:1788526725.504041:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788526725.512525:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512543:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512567:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512574:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526725.512580:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512588:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512606:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526725.512609:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526725.512614:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.512621:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76a00/0x367645d450b3acc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.593798:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881556864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526725.593920:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526725.594118:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881556864 00000100:00100000:1.0:1788526725.594148:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881556864 00000100:00100000:1.0:1788526725.594208:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788526725.594218:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881556864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526725.594249:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526725.594319:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881556864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526725.594328:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788526725.594451:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2430a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881556864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526725.784320:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526725.784525:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526725.784574:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526725.785453:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964864 00000100:00100000:2.0:1788526725.785472:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964864 00000100:00100000:2.0:1788526725.785585:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:2.0:1788526725.785612:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868964864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526725.785727:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868964864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 118us (1151us total) trans 0 rc 0/0 00000100:00080000:0.0:1788526725.785822:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526725.785911:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1788526725.786033:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964992 00000100:00100000:1.0:1788526725.786039:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964992 00000100:00100000:1.0:1788526725.786085:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:1.0:1788526725.786093:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868964992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526725.786133:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2350:x1875405868964992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 42us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526725.786140:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1788526725.788594:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868964736 00000100:00100000:3.0:1788526725.788615:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868964736 00000100:00100000:3.0:1788526725.788706:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 322 00000100:00100000:3.0:1788526725.788718:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868964736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526725.789148:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868964736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 431us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526725.789158:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 322 00000100:00100000:1.0:1788526725.802560:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.802710:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868965120 00000100:00100000:3.0:1788526725.802725:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868965120 00000100:00100000:3.0:1788526725.802819:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:3.0:1788526725.802831:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+42:11421:x1875405868965120:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:3.0:1788526725.802868:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526725.802907:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3accd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59628 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803000:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803018:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803035:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803053:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803060:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803092:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803212:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803224:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803233:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803281:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.803298:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 43 pid: 5824 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.803316:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27469ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881556992:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526725.803498:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526725.809164:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526725.809786:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868965376 00000100:00100000:2.0:1788526725.809800:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868965376 00000100:00100000:2.0:1788526725.809902:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1788526725.809915:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+44:5588:x1875405868965376:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788526725.810475:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+45:5588:x1875405868965376:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 559us (1324us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788526725.810484:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1788526725.810558:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27469ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881556992:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526725.810597:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526725.818249:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526725.818864:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868965504 00000100:00100000:3.0:1788526725.818891:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868965504 00010000:00010000:3.0:1788526725.818962:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 45 pid: 5824 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526725.819355:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1788526725.819368:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+45:2348:x1875405868965504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526725.819440:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526725.819448:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 45 pid: 5824 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819463:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 45 pid: 5824 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819491:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3acb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59621 expref: 45 pid: 5824 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819512:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526725.819517:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819528:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819537:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.819649:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526725.819761:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+44:2348:x1875405868965504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 396us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526725.819771:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00010000:00010000:1.0:1788526725.820981:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821127:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526725.821198:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788526725.821203:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526725.821232:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821252:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821265:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821296:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821304:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821311:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526725.821317:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821327:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821347:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526725.821351:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526725.821357:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821364:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3acd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821492:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821501:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821507:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821512:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526725.821522:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821606:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821617:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8bc00) 00010000:00010000:1.0:1788526725.821620:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526725.821623:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821629:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3acdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821687:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3accd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59628 expref: 44 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821702:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59628 expref: 43 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526725.821888:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:1.0:1788526725.821891:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526725.821895:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7800, rc 0) 00000100:00100000:1.0:1788526725.821979:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+43:11421:x1875405868965120:12345-192.168.204.59@tcp:101:stat.0 Request processed in 19149us (19436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526725.821989:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:0.0:1788526725.882332:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526725.882512:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868965760 00000100:00100000:2.0:1788526725.882676:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868965760 00000100:00100000:2.0:1788526725.882910:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 157 00000100:00100000:2.0:1788526725.882922:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+43:11427:x1875405868965760:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:2.0:1788526725.883011:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526725.883053:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3ace2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59628 expref: 43 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.883082:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526725.883090:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526725.883454:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.883473:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526725.883486:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526725.883564:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788526725.883596:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e73df58b reply state 00000000987aa0e9 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526725.883607:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526725.883765:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+45:11427:x1875405868965760:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 843us (1449us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788526725.883796:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 157 00000020:00080000:2.0:1788526725.883802:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788526725.893425:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.893468:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.893477:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.893484:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526725.893497:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.893507:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.894664:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526725.894675:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526725.894683:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526725.894694:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ace9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.053602:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.054263:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868965888 00000100:00100000:2.0:1788526726.054470:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868965888 00000100:00080000:0.0:1788526726.054613:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526726.054762:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:2.0:1788526726.054778:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+44:11441:x1875405868965888:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:2.0:1788526726.054818:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526726.054849:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3acf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5962f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.054955:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.054975:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.054990:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055024:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055044:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055052:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055174:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055208:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055216:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526726.055268:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788526726.055275:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526726.055306:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055331:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055338:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055347:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055354:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526726.055360:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055369:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055418:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526726.055429:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526726.055437:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055444:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3acf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055462:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055468:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055474:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055480:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526726.055483:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055489:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055496:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c260d60200) 00010000:00010000:2.0:1788526726.055499:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526726.055502:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055507:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3acfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055560:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3acf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055588:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 45 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.055596:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526726.055599:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526726.055602:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77800, rc 0) 00000100:00100000:2.0:1788526726.055698:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+45:11441:x1875405868965888:12345-192.168.204.59@tcp:101:stat.0 Request processed in 925us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526726.055706:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:2.0:1788526726.141352:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.141688:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868966144 00000100:00100000:1.0:1788526726.141703:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868966144 00000100:00100000:1.0:1788526726.141829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:1.0:1788526726.141842:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+45:11451:x1875405868966144:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526726.141903:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526726.141939:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3ad0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59636 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526726.142119:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788526726.142296:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3ad0c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59636 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.142313:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:1.0:1788526726.142317:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526726.142323:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3ad0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59636 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.142341:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111800, rc 0) 00000100:00100000:1.0:1788526726.142626:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:11451:x1875405868966144:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 785us (1290us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788526726.142636:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:3.0:1788526726.145965:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.146647:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868966400 00000100:00100000:2.0:1788526726.146665:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868966400 00000100:00100000:2.0:1788526726.146788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1788526726.146801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+46:11451:x1875405868966400:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526726.147754:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+47:11451:x1875405868966400:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 949us (1800us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788526726.147766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1788526726.224038:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.226971:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868966656 00000100:00100000:1.0:1788526726.226995:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868966656 00000100:00100000:1.0:1788526726.227235:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:1.0:1788526726.227257:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+47:11457:x1875405868966656:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1788526726.227291:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526726.227320:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3ad1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5963d expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.227495:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.227553:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.227564:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.227636:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 48 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.227653:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 48 pid: 5823 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526726.227669:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881557120:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526726.227825:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a370840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526726.234579:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881557120:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526726.234621:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526726.234946:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526726.236364:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868966784 00000100:00100000:3.0:1788526726.236381:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868966784 00010000:00010000:3.0:1788526726.236458:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 49 pid: 5823 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526726.236513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1788526726.236524:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+49:2348:x1875405868966784:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526726.236563:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526726.236571:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 49 pid: 5823 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236598:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 49 pid: 5823 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236627:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77800/0x367645d450b3ad05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5962f expref: 49 pid: 5823 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236648:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526726.236653:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236664:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236673:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.236849:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526726.236944:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+48:2348:x1875405868966784:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 419us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526726.236962:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00010000:00010000:0.0:1788526726.238397:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.238418:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526726.238448:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788526726.238695:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3ad1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 49 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.239283:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 48 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.239298:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526726.239302:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788526726.239307:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:0.0:1788526726.239519:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+48:11457:x1875405868966656:12345-192.168.204.59@tcp:101:bash.0 Request processed in 12272us (15496us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788526726.239529:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:2.0:1788526726.243287:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.244131:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967040 00000100:00100000:0.0:1788526726.244147:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967040 00000100:00100000:0.0:1788526726.244278:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:0.0:1788526726.244291:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+48:11457:x1875405868967040:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1788526726.244745:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.244768:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.244782:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526726.244850:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788526726.244893:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad261de6 reply state 00000000a9cf9b92 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.244903:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526726.245074:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+51:11457:x1875405868967040:12345-192.168.204.59@tcp:36:bash.0 Request processed in 783us (1801us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788526726.245083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 161 00000020:00080000:0.0:1788526726.245090:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788526726.247493:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.247515:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.247536:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.247544:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526726.247968:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.247980:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.248013:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:1.0:1788526726.248017:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526726.248024:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.248032:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3ad2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526726.251468:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.251742:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967168 00000100:00100000:0.0:1788526726.251758:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967168 00000100:00100000:0.0:1788526726.251841:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:0.0:1788526726.251854:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:11457:x1875405868967168:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526726.251903:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526726.251932:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ad36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59644 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.252063:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.252082:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 51 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.252093:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.252151:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 51 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.252168:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 51 pid: 6721 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.252185:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875405881557248:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526726.252301:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526726.256257:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875405881557248:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526726.256304:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526726.257957:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.258274:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967296 00000100:00100000:0.0:1788526726.258288:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967296 00010000:00010000:0.0:1788526726.258349:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 52 pid: 6721 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.262160:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:0.0:1788526726.262199:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+52:2349:x1875405868967296:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526726.262229:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526726.262244:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 52 pid: 6721 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262264:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 52 pid: 6721 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262295:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ad21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5963d expref: 52 pid: 6721 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262318:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526726.262326:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262337:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262346:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.262468:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526726.262559:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:2349:x1875405868967296:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 381us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526726.262569:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00010000:00010000:2.0:1788526726.262950:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.262962:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526726.263049:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788526726.263054:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526726.263096:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.263138:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3ad36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59644 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.263160:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59644 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.263169:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526726.263173:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526726.263176:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:2.0:1788526726.263236:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:11457:x1875405868967168:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11385us (11783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526726.263245:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:2.0:1788526726.273843:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.274282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967552 00000100:00100000:0.0:1788526726.274297:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967552 00000100:00100000:0.0:1788526726.274546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1788526726.274559:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:11457:x1875405868967552:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1788526726.275141:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:11457:x1875405868967552:12345-192.168.204.59@tcp:35:bash.0 Request processed in 581us (1309us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788526726.275151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00010000:00010000:0.0:1788526726.356261:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526726.361615:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.361822:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967808 00000100:00100000:1.0:1788526726.361837:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967808 00000100:00100000:1.0:1788526726.361920:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:1.0:1788526726.361934:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+51:11467:x1875405868967808:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526726.361973:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526726.362003:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3ad44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5964b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526726.362128:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788526726.362310:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3ad44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5964b expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.362328:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:1.0:1788526726.362331:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526726.362338:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3ad44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5964b expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.362381:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110c00, rc 0) 00000100:00100000:1.0:1788526726.362504:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:11467:x1875405868967808:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 573us (904us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788526726.362513:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:3.0:1788526726.365525:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.366339:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868967936 00000100:00100000:0.0:1788526726.366358:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868967936 00000100:00100000:0.0:1788526726.366716:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:0.0:1788526726.366731:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+52:11467:x1875405868967936:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1788526726.366852:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.366884:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.366899:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.366918:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.366950:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.366958:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367105:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367115:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367122:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526726.367180:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367196:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367216:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367225:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367231:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526726.367236:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367245:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367267:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526726.367270:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526726.367276:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367283:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ad52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367298:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367305:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367312:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367317:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526726.367320:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367326:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367334:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c243972900) 00010000:00010000:0.0:1788526726.367337:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526726.367340:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367346:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3ad59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367377:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367384:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367435:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367440:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526726.367444:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367450:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367459:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526726.367461:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526726.367465:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.367471:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.367581:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+52:11467:x1875405868967936:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 853us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526726.367590:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:2.0:1788526726.371225:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526726.371334:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868968192 00000100:00100000:3.0:1788526726.371350:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868968192 00000100:00100000:3.0:1788526726.371548:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1788526726.371581:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+52:11467:x1875405868968192:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526726.372147:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+53:11467:x1875405868968192:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 567us (946us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788526726.372157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1788526726.424601:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.426563:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868968448 00000100:00100000:1.0:1788526726.426588:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868968448 00000100:00100000:1.0:1788526726.429978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:1.0:1788526726.430013:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+53:11470:x1875405868968448:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526726.430056:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526726.430088:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3ad67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59652 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430198:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430216:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430229:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430245:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430252:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430259:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430480:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ad7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430490:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ad7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430497:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ad7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526726.430509:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788526726.430634:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430643:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430651:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430657:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526726.430662:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430671:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430697:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526726.430701:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526726.430707:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430725:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3ad6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430744:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430749:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430755:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430760:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526726.430764:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430770:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430779:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c272284600) 00010000:00010000:1.0:1788526726.430781:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526726.430784:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430789:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3ad75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430840:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3ad67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59652 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430854:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ad7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59652 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.430880:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:1.0:1788526726.430883:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526726.430886:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110600, rc 0) 00000100:00100000:1.0:1788526726.430977:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27469e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+55:11470:x1875405868968448:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 984us (6394us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788526726.430985:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:2.0:1788526726.434295:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.437567:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526726.439190:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868968576 00000100:00100000:3.0:1788526726.439213:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868968576 00000100:00100000:3.0:1788526726.439327:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1788526726.439340:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+55:2349:x1875405868968576:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526726.439362:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526726.439421:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ad7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59652 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526726.439449:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:3.0:1788526726.439456:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526726.439544:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+54:2349:x1875405868968576:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 206us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526726.439552:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526726.441613:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868968704 00000100:00100000:1.0:1788526726.441631:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868968704 00000100:00100000:0.0:1788526726.442275:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:0.0:1788526726.442295:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:11470:x1875405868968704:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1788526726.442457:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442482:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442497:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442537:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442546:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442554:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442562:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526726.442568:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442578:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442592:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:0.0:1788526726.442596:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526726.442602:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.442608:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ad8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526726.444526:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:11470:x1875405868968704:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 2221us (10230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526726.444544:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:2.0:1788526726.450116:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.450242:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868968960 00000100:00100000:1.0:1788526726.450257:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868968960 00000100:00100000:1.0:1788526726.450335:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1788526726.450349:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:11470:x1875405868968960:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526726.452376:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:11470:x1875405868968960:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 2013us (2262us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788526726.452409:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1788526726.654630:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.655162:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868969216 00000100:00100000:2.0:1788526726.655178:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868969216 00000100:00100000:2.0:1788526726.655323:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:2.0:1788526726.655339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:11488:x1875405868969216:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1788526726.655434:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526726.655486:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ad91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59659 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.655644:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ad98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.655665:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ad98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.655692:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ad98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526726.655705:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788526726.655903:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3ad91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59659 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.655928:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ad98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59659 expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.655938:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:2.0:1788526726.655942:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788526726.655948:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77400, rc 0) 00000100:00100000:2.0:1788526726.656054:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:11488:x1875405868969216:12345-192.168.204.59@tcp:101:cat.0 Request processed in 718us (1442us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788526726.656062:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:3.0:1788526726.687652:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526726.690462:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868969344 00000100:00100000:0.0:1788526726.690485:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868969344 00000100:00100000:0.0:1788526726.690606:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1788526726.690619:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+57:11489:x1875405868969344:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526726.690653:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526726.690681:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ada6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59660 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691283:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691304:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691322:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526726.691372:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788526726.691376:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526726.691427:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691466:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3ada6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59660 expref: 59 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691515:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59660 expref: 58 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526726.691527:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526726.691530:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526726.691535:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526726.691629:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+58:11489:x1875405868969344:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1011us (3997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526726.691638:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:3.0:1788526726.695525:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.698267:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868969728 00000100:00100000:2.0:1788526726.698289:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868969728 00000100:00100000:2.0:1788526726.698381:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1788526726.698617:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:11489:x1875405868969728:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526726.700758:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+59:11489:x1875405868969728:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 2136us (5250us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788526726.700786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:0.0:1788526726.712702:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.712827:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868969856 00000100:00100000:1.0:1788526726.712843:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868969856 00000100:00100000:1.0:1788526726.712939:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1788526726.712950:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+59:11489:x1875405868969856:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:1.0:1788526726.712970:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788526726.713004:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3ad3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59644 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.713030:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3ad98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59659 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.713069:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55200/0x367645d450b3ac48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59605 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.713080:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b300) 00010000:00010000:1.0:1788526726.713093:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526726.713166:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+56:11489:x1875405868969856:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 217us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526726.713174:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526726.717024:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526726.717444:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868969984 00000100:00100000:1.0:1788526726.717462:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868969984 00000100:00100000:1.0:1788526726.717650:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:1.0:1788526726.717665:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:11489:x1875405868969984:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:1.0:1788526726.718323:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.718350:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526726.718366:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526726.718698:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788526726.719241:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:11489:x1875405868969984:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 1573us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526726.719252:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:0.0:1788526726.755696:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526726.755835:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868970112 00000100:00100000:2.0:1788526726.755850:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868970112 00000100:00100000:2.0:1788526726.755937:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:2.0:1788526726.755949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+56:11491:x1875405868970112:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526726.755980:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526726.756011:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3adbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59667 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756121:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756140:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756154:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756172:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756179:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756185:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756326:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756336:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756343:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526726.756449:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788526726.756455:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526726.756481:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756498:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756508:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756515:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756523:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756531:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526726.756536:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756546:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756570:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526726.756573:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526726.756580:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756587:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3adc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756604:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756610:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756616:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756622:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526726.756624:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756631:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756639:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c260d60200) 00010000:00010000:2.0:1788526726.756641:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526726.756644:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756650:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77400/0x367645d450b3adc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756703:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76c00/0x367645d450b3adbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 58 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756719:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526726.756726:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:2.0:1788526726.756728:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526726.756732:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77600, rc 0) 00000100:00100000:2.0:1788526726.756828:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+57:11491:x1875405868970112:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 880us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526726.756837:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00010000:00010000:3.0:1788526727.379711:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526727.635807:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526727.635822:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526727.635896:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788526727.635905:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526727.636106:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b576300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881557376:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788526727.636288:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2430bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526727.646175:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b576300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881557376:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788526727.646792:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.646861:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868970240 00000100:00100000:0.0:1788526727.646871:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868970240 00000100:00100000:0.0:1788526727.646952:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:0.0:1788526727.646964:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:11502:x1875405868970240:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788526727.647012:0:5823:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788526727.647684:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:11502:x1875405868970240:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 720us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.647694:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:0.0:1788526727.667596:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526727.669422:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868970368 00000100:00100000:3.0:1788526727.669457:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868970368 00000100:00100000:3.0:1788526727.669620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1788526727.669634:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+57:11502:x1875405868970368:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788526727.669742:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669775:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669792:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669812:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669820:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669827:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669874:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669884:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669893:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526727.669946:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788526727.669952:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526727.669971:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.669984:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670001:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670009:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670016:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526727.670022:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670031:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670046:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:3.0:1788526727.670049:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526727.670055:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670062:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3add7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670076:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670081:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670086:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670090:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526727.670098:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670105:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670113:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98c242a8b500) 00010000:00010000:3.0:1788526727.670116:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526727.670119:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670125:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3adde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670141:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670147:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670153:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670157:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526727.670160:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670166:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670174:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:3.0:1788526727.670176:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526727.670186:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.670193:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ade5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526727.670315:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+57:11502:x1875405868970368:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 681us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526727.670324:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1788526727.673284:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.673614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868970624 00000100:00100000:0.0:1788526727.673629:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868970624 00000100:00100000:0.0:1788526727.674290:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:0.0:1788526727.674307:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+57:11502:x1875405868970624:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526727.674358:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526727.674416:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3adec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5966e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674559:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674577:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674591:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526727.674603:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788526727.674944:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674953:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674962:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674969:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526727.674974:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674983:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.674998:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:0.0:1788526727.675009:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526727.675026:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.675033:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3adf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.675094:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3adec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5966e expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.675107:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:0.0:1788526727.675109:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526727.675114:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3adec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5966e expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.675125:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820000, rc 0) 00000100:00100000:0.0:1788526727.675213:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868970624:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 912us (1945us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788526727.675221:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:1.0:1788526727.679991:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.680189:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868970752 00000100:00100000:0.0:1788526727.680204:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868970752 00000100:00100000:0.0:1788526727.680287:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:0.0:1788526727.680301:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868970752:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788526727.680559:0:6721:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788526727.680856:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868970752:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 544us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.680865:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:3.0:1788526727.706989:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.708865:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971008 00000100:00100000:0.0:1788526727.708908:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971008 00000100:00100000:0.0:1788526727.709016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:0.0:1788526727.709029:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868971008:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526727.709057:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526727.709062:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788526727.709097:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3adad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59660 expref: 58 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.709124:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526727.709131:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526727.709149:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59675 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788526727.709760:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788526727.710042:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.710061:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.710073:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.710151:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59675 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.710172:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59675 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.710199:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c243972900) 00010000:00010000:0.0:1788526727.710202:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526727.710205:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821e00, rc 0) 00000100:00100000:0.0:1788526727.710315:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+59:11502:x1875405868971008:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1287us (3341us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788526727.710324:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:1.0:1788526727.727082:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526727.727699:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971264 00000100:00100000:2.0:1788526727.727715:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971264 00000100:00100000:2.0:1788526727.727802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:2.0:1788526727.727816:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+59:11502:x1875405868971264:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788526727.727919:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526727.727968:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59675 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.727989:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c243972900) 00010000:00010000:2.0:1788526727.728004:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526727.728036:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728053:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728084:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728103:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728111:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728118:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728202:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728211:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728219:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728226:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526727.728232:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728241:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728250:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526727.728254:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526727.728258:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728271:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77a00/0x367645d450b3ae16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728282:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728289:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728295:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728299:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526727.728303:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728309:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728317:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdb92be5b (ffff98c260d60200) 00010000:00010000:2.0:1788526727.728320:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526727.728323:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526727.728329:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77200/0x367645d450b3ae1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb92be5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526727.728481:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868971264:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 667us (1414us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526727.728490:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:0.0:1788526727.731867:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526727.732037:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971392 00000100:00100000:1.0:1788526727.732053:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971392 00000100:00100000:1.0:1788526727.732136:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:1.0:1788526727.732148:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:11502:x1875405868971392:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526727.732179:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526727.732213:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ae24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5967c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732266:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732284:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732297:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732479:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3ae24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732501:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.732519:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:1.0:1788526727.732523:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526727.732526:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:1.0:1788526727.732606:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+59:11502:x1875405868971392:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 460us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526727.732625:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:3.0:1788526727.737368:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.737469:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971648 00000100:00100000:0.0:1788526727.737484:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971648 00000100:00100000:0.0:1788526727.737558:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:0.0:1788526727.737571:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+59:11502:x1875405868971648:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788526727.737718:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.737742:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.737756:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526727.738199:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788526727.738211:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363078823585ns, next at 364078820801ns, rc = 0 00000004:00010000:0.0:1788526727.738345:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c459b5ff reply state 0000000012744cae transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526727.738359:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526727.738550:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:11502:x1875405868971648:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 979us (1201us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788526727.738575:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 178 00010000:00010000:0.0:1788526727.744814:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744839:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744861:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744867:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526727.744873:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744883:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744907:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526727.744911:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788526727.744916:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.744922:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3ae32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526727.746335:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.746898:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971776 00000100:00100000:0.0:1788526727.746915:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971776 00000100:00100000:0.0:1788526727.747038:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:0.0:1788526727.747051:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:11502:x1875405868971776:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526727.747088:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526727.747139:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59683 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.747234:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.747250:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.747275:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526727.747279:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788526727.747283:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526727.747457:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:11502:x1875405868971776:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 407us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.747465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:3.0:1788526727.755516:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526727.755756:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868971904 00000100:00100000:1.0:1788526727.755772:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868971904 00000100:00100000:1.0:1788526727.755890:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1788526727.755907:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868971904:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788526727.756471:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868971904:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 567us (972us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788526727.756481:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00080000:0.0:1788526727.756818:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526727.763606:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526727.763997:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868972160 00000100:00100000:1.0:1788526727.764012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868972160 00000100:00100000:1.0:1788526727.764093:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1788526727.764105:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:11502:x1875405868972160:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788526727.765123:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+62:11502:x1875405868972160:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1525us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788526727.765134:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1788526727.778892:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526727.780040:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868972416 00000100:00100000:2.0:1788526727.780061:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868972416 00000100:00100000:2.0:1788526727.780162:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:2.0:1788526727.780176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+62:11502:x1875405868972416:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788526727.780351:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+62:11502:x1875405868972416:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 177us (1477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526727.780360:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:2.0:1788526727.786628:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526727.786720:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868972544 00000100:00100000:1.0:1788526727.786734:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868972544 00000100:00100000:1.0:1788526727.786813:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:1.0:1788526727.786827:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+62:11502:x1875405868972544:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526727.786875:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526727.786904:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3ae40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5968a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787000:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787021:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787036:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526727.787086:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526727.787112:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787145:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3ae40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5968a expref: 64 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787169:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5968a expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.787180:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:1.0:1788526727.787183:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788526727.787188:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110400, rc 0) 00000100:00100000:1.0:1788526727.787281:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+63:11502:x1875405868972544:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 457us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526727.787289:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1788526727.802936:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.809639:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868972672 00000100:00100000:0.0:1788526727.809662:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868972672 00000100:00100000:0.0:1788526727.809766:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:0.0:1788526727.809779:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868972672:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526727.809805:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526727.809833:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59691 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526727.809881:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac087, blocks: 0x1 00010000:00010000:0.0:1788526727.809908:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788526727.809913:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526727.809926:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.809972:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.809988:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820000, rc 0) 00000100:00100000:0.0:1788526727.810082:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868972672:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 305us (7166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.810090:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1788526727.813040:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.813459:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868972928 00000100:00100000:0.0:1788526727.813473:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868972928 00000100:00100000:0.0:1788526727.813550:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:0.0:1788526727.813564:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+63:11502:x1875405868972928:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788526727.813748:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+63:11502:x1875405868972928:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 187us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.813757:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:3.0:1788526727.818982:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526727.819343:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973056 00000100:00100000:1.0:1788526727.819364:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973056 00000100:00100000:1.0:1788526727.819480:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1788526727.819493:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:11502:x1875405868973056:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526727.819518:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526727.819542:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59698 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.819587:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.819598:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526727.819603:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526727.819620:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.819671:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.819688:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 9 pid: 6670 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526727.819708:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b577100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881557504:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526727.819856:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2430bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788526727.824575:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.824635:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973184 00000100:00100000:0.0:1788526727.824650:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973184 00010000:00010000:0.0:1788526727.824715:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 10 pid: 6670 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526727.824767:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1788526727.824779:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+10:2348:x1875405868973184:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526727.824800:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526727.824859:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 10 pid: 6670 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.824877:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 10 pid: 6670 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.824911:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526727.824917:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526727.824928:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.824941:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526727.824995:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 10 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526727.825013:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1875405881557632:192.168.204.59@tcp:105: 00000100:00100000:0.0:1788526727.825114:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2452363c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788526727.825465:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcf6fe27/0x367645d450b3ae4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59691 expref: 10 pid: 6670 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526727.825484:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b577100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881557504:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526727.825521:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526727.825535:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110200, rc 0) 00000100:00100000:3.0:1788526727.825575:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:11502:x1875405868973056:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 6086us (6615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526727.825596:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1788526727.829579:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5810:1875405881557632:192.168.204.59@tcp:105: 00010000:00010000:0.0:1788526727.829632:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526727.829725:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868973184:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 4946us (5174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.829739:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1788526727.830618:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.831201:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973312 00000100:00100000:0.0:1788526727.831213:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973312 00002000:00100000:0.0:1788526727.831317:0:12064:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98c249742680 x1875405868973312/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:443/0 lens 504/0 e 0 to 0 dl 1788526738 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526727.831330:0:12064:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c249742680 with x1875405868973312 ext(0->8) 00002000:00010000:0.0:1788526727.831337:0:12064:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c249742680 00000100:00100000:0.0:1788526727.831380:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1788526727.831411:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868973312:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788526727.832184:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f122900d-e71c-4fc3-b559-b19040da7c34+10:2349:x1875405868973312:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 770us (1565us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788526727.832195:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00002000:00100000:0.0:1788526727.832203:0:12064:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98c249742680 x1875405868973312/t4294967314(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:443/0 lens 504/448 e 0 to 0 dl 1788526738 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788526727.832215:0:12064:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c249742680 with x1875405868973312 ext(0->8) 00002000:00010000:0.0:1788526727.832221:0:12064:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c249742680 00000100:00100000:3.0:1788526727.834538:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526727.835546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973440 00000100:00100000:0.0:1788526727.835563:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973440 00000100:00100000:0.0:1788526727.835655:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:0.0:1788526727.835667:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+63:11502:x1875405868973440:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788526727.924173:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+63:11502:x1875405868973440:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 88487us (89630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526727.924191:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 183 00000001:00080000:0.0:1788526727.924499:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1788526727.924568:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788526727.924613:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788526727.924668:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788526727.924686:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c2484f7600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788526727.924710:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274628300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c2484f7c00 00000020:00080000:0.0:1788526727.924714:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274628500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c26e9db400 00000020:00080000:0.0:1788526727.924775:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788526727.925439:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788526727.925882:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526727.925908:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881557760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788526727.925963:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881557888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788526727.926018:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526727.926055:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881557888 00000100:00100000:1.0:1788526727.926066:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881557888 00000100:00100000:1.0:1788526727.926141:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788526727.926152:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875405881557888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788526727.926187:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788526727.926231:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ac083, atime: 0x6a9ac084, ctime: 0x6a9ac083, blocks: 0x1 00010000:00010000:1.0:1788526727.926241:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.926263:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788526727.926269:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526727.926276:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.926296:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.926307:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.926316:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.926337:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788526727.927260:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526727.928355:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881557888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2197us (2330us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788526727.928370:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788526727.928491:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881557760 00000100:00100000:1.0:1788526727.928502:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881557760 00000100:00100000:1.0:1788526727.928556:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788526727.928564:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881557760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788526727.928775:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00000004:00080000:3.0:1788526727.928777:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c249742d80/2, rc 0, transno 4294967307 00002000:00010000:1.0:1788526727.928779:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788526727 00002000:00010000:1.0:1788526727.928782:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788526727.928783:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788526727 -> 1788526727 00002000:00010000:1.0:1788526727.928785:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788526727.928786:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881557888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788526727.928855:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881557760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 292us (1597us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788526727.928862:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788526727.928929:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526727.928959:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973568 00000100:00100000:3.0:1788526727.928963:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973568 00000100:00100000:3.0:1788526727.928989:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1788526727.928996:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+10:2349:x1875405868973568:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1788526727.929162:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526727.929169:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788526727.929188:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526727.929199:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.929215:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526727.929221:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.929235:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.929261:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.929282:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef235592/0x367645d450b3ae5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526727.929307:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526727.929309:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526727.929310:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788526727.929378:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c249741880/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788526727.929484:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881557760:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788526727.985078:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788526727.985109:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788526727.987812:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868973568:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 58796us (58868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526727.987834:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1788526728.003893:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526728.004003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973824 00000100:00100000:0.0:1788526728.004019:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973824 00000100:00100000:0.0:1788526728.004125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:0.0:1788526728.004139:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+18:11502:x1875405868973824:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788526728.004215:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526728.004246:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3ae47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5968a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.004268:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526728.004274:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526728.004320:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.004340:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.004351:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788526728.004645:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1788526728.006450:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8d5ed94 reply state 000000000bcf1928 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526728.006474:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788526728.008360:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+19:11502:x1875405868973824:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 4209us (4471us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788526728.008400:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 184 00010000:00010000:2.0:1788526728.015546:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015572:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015581:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015589:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526728.015596:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015606:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015740:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:2.0:1788526728.015743:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526728.015756:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.015762:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821e00/0x367645d450b3ae63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.020230:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526728.028462:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868973952 00000100:00100000:2.0:1788526728.028479:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868973952 00000100:00100000:2.0:1788526728.028743:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:2.0:1788526728.028761:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868973952:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788526728.029926:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788526728.029932:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788526727 -> 1788526725 00002000:00010000:2.0:1788526728.029936:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788526724 00002000:00010000:2.0:1788526728.029938:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788526727 -> 1788526725 00002000:00010000:2.0:1788526728.029940:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788526728.030026:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868973952:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 1268us (9809us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788526728.030037:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1788526728.032540:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526728.038487:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974208 00000100:00100000:1.0:1788526728.038507:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974208 00000100:00100000:1.0:1788526728.038594:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:1.0:1788526728.038608:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:11502:x1875405868974208:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788526728.038718:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.038741:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.038752:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.038802:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.038826:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 18 pid: 5822 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.038855:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b574380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881558016:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526728.038985:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2491eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788526728.046267:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526728.047876:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974336 00000100:00100000:2.0:1788526728.047899:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974336 00010000:00010000:2.0:1788526728.047968:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 19 pid: 5822 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526728.048025:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:2.0:1788526728.048038:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:2348:x1875405868974336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526728.048059:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526728.048070:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 19 pid: 5822 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.048100:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 19 pid: 5822 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.048136:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:2.0:1788526728.048142:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.048154:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.048164:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.048199:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526728.048296:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:2348:x1875405868974336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 259us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526728.048308:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00010000:00010000:1.0:1788526728.048914:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3ae2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5967c expref: 18 pid: 5822 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.048935:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b574380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881558016:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526728.048969:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.048980:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.048986:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049030:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049038:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049046:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049053:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526728.049067:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049078:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049093:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:1.0:1788526728.049096:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788526728.049101:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.049108:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3ae6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.049173:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+17:11502:x1875405868974208:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 10568us (16650us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788526728.049182:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:3.0:1788526728.053662:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526728.053796:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974464 00000100:00100000:1.0:1788526728.053811:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974464 00000100:00100000:1.0:1788526728.053903:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1788526728.053916:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868974464:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788526728.054050:0:12011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.054160:0:12011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.054172:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526728.054178:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526728.054208:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.054256:0:12011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.054275:0:12011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 8 pid: 6671 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.054294:0:12011:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12011:1875405881558144:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526728.054688:0:12011:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2491eb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788526728.058519:0:12011:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12011:1875405881558144:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526728.058565:0:12011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526728.058867:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526728.059416:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974592 00000100:00100000:1.0:1788526728.059428:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974592 00010000:00010000:1.0:1788526728.060158:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.060277:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:1.0:1788526728.060290:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868974592:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526728.060311:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526728.060343:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.060372:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.060437:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000937b9e53/0x367645d450b3ae55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59698 expref: 9 pid: 6671 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.060458:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526728.060464:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526728.060471:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.060482:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.060523:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526728.060604:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868974592:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 316us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526728.060624:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00010000:00010000:3.0:1788526728.060696:0:12011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060707:0:12011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060739:0:12011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060777:0:12011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060786:0:12011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060793:0:12011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526728.060806:0:12011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060817:0:12011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060833:0:12011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526728.060851:0:12011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010162200/0x367645d450b3ae71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526728.060928:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868974464:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 7015us (7282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526728.060937:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1788526728.072370:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526728.072435:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974848 00000100:00100000:2.0:1788526728.072449:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974848 00000100:00100000:2.0:1788526728.072525:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:2.0:1788526728.072537:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+17:11502:x1875405868974848:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788526728.072641:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.072664:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.072699:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.073070:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.073084:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.073094:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.073135:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.073150:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 18 pid: 5823 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526728.073167:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881558272:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526728.073273:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c274b83f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526728.079874:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881558272:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526728.079920:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526728.080568:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526728.080694:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868974976 00000100:00100000:0.0:1788526728.080705:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868974976 00010000:00010000:0.0:1788526728.080760:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 19 pid: 5823 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526728.080816:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:0.0:1788526728.080829:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:2349:x1875405868974976:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526728.080858:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526728.080866:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 19 pid: 5823 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.080882:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 19 pid: 5823 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.080915:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59683 expref: 19 pid: 5823 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.080934:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:0.0:1788526728.081010:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.081023:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.081032:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.081080:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526728.081146:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:2349:x1875405868974976:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 318us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526728.081154:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00010000:00010000:2.0:1788526728.081563:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.081584:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526728.084989:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788526728.085278:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788526728.085329:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788526728.085481:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881558400:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788526728.085579:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526728.085628:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526728.086059:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881558400 00000100:00100000:0.0:1788526728.086072:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881558400 00000100:00100000:0.0:1788526728.086148:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788526728.086162:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6721:x1875405881558400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788526728.086277:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6721:x1875405881558400:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526728.086286:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526728.088276:0:6721:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788526728.088293:0:6721:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c249741880, transno 4294967315 00000100:00100000:2.0:1788526728.088322:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881558400:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788526728.088982:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788526728.089094:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881558528:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788526728.089175:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526728.089226:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c274b83f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526728.089300:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881558528 00000100:00100000:1.0:1788526728.089312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881558528 00000100:00100000:1.0:1788526728.089383:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788526728.089418:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6721:x1875405881558528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788526728.090381:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6721:x1875405881558528:12345-0@lo:1000:mdt00_003.0 Request processed in 960us (1197us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788526728.090425:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526728.092923:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6721:1875405881558528:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788526728.093004:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093017:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093026:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093032:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526728.093038:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093070:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093098:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c272284d00) 00010000:00010000:2.0:1788526728.093102:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788526728.093110:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093117:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3ae7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093168:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093174:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093180:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093185:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526728.093188:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093194:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093203:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:2.0:1788526728.093205:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788526728.093208:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093225:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110c00/0x367645d450b3adb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093261:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093277:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093287:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093344:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526728.093367:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 21 pid: 5824 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526728.095481:0:12403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788526728.095498:0:12403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788526728.095553:0:12403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788526728.095561:0:12403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788526728.099845:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881558656:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526728.100014:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247d840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526728.104998:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526728.109556:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868975104 00000100:00100000:1.0:1788526728.109578:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868975104 00010000:00010000:1.0:1788526728.109640:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 22 pid: 5824 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.109689:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:1.0:1788526728.109702:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+22:2348:x1875405868975104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526728.109722:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526728.109730:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 22 pid: 5824 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.109746:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 22 pid: 5824 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.109775:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:1.0:1788526728.109781:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.109793:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.109803:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.109830:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526728.109918:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+22:2348:x1875405868975104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 218us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526728.109926:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00010000:00010000:1.0:1788526728.110147:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3add0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59667 expref: 21 pid: 5824 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.110183:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881558656:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526728.110213:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110224:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110231:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110248:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110256:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110264:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110271:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526728.110277:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110285:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110295:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:1.0:1788526728.110299:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526728.110303:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110320:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3ae86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110332:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110339:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110345:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110350:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526728.110354:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110360:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110368:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c272284600) 00010000:00010000:1.0:1788526728.110371:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526728.110374:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.110380:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3ae78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526728.110772:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+20:11502:x1875405868974848:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 38234us (38415us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788526728.110782:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000020:00080000:1.0:1788526728.110794:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788526728.110959:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526728.110965:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526728.111515:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788526728.111531:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788526728.117903:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526728.118043:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868975360 00000100:00100000:0.0:1788526728.118059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868975360 00000100:00100000:0.0:1788526728.118136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:0.0:1788526728.118148:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+20:11502:x1875405868975360:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788526728.119169:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788526728.119306:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788526728.119365:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120640:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120689:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120703:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120710:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120716:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526728.120808:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788526728.120997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:11502:x1875405868975360:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2846us (3107us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788526728.121009:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000020:00080000:0.0:1788526728.121017:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788526728.125717:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526728.125738:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.125752:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526728.125757:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.125770:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.125806:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98c243972300) 00010000:00010000:1.0:1788526728.125809:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788526728.125816:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.125823:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3ae8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526728.125855:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526728.125857:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526728.125859:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788526728.222049:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788526728.222084:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:0.0:1788526728.403696:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526729.428243:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526729.684903:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881558784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526729.688239:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526729.688408:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881558784 00000100:00100000:1.0:1788526729.688420:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881558784 00000100:00100000:1.0:1788526729.688499:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788526729.688511:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881558784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526729.688574:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526729.688642:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881558784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526729.688651:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788526729.688675:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526729.688724:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881558784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526729.689323:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881559296:0@lo:400:kworker.0 00000100:00100000:0.0:1788526729.689373:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526729.689426:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526729.689432:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881559168:0@lo:400:kworker.0 00000100:00100000:0.0:1788526729.689463:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526729.689494:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881559168 00000100:00100000:0.0:1788526729.689499:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881559168 00000100:00100000:3.0:1788526729.689614:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881559040:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.689650:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526729.689674:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788526729.689680:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881558912:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.689712:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526729.689740:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881559424:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.689763:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526729.689795:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881559296 00000100:00100000:3.0:1788526729.689799:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881559296 00000100:00100000:3.0:1788526729.689853:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788526729.689861:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881559296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.689909:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881559296:12345-0@lo:400:kworker.0 Request processed in 49us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526729.689916:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788526729.689938:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881559040 00000100:00100000:3.0:1788526729.689941:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881559040 00000100:00100000:3.0:1788526729.690047:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881559424 00000100:00100000:3.0:1788526729.690052:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881559424 00000100:00100000:3.0:1788526729.690071:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788526729.690077:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690116:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881559040:12345-0@lo:400:kworker.0 Request processed in 39us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526729.690123:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788526729.690135:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788526729.690142:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881559424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690189:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881559424:12345-0@lo:400:kworker.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526729.690196:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788526729.690216:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881558912 00000100:00100000:3.0:1788526729.690220:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881558912 00000100:00100000:3.0:1788526729.690249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788526729.690258:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881558912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690290:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881558912:12345-0@lo:400:kworker.0 Request processed in 34us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526729.690296:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788526729.690349:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881558912:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690362:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881559424:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690373:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881559040:0@lo:400:kworker.0 00000100:00100000:3.0:1788526729.690442:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788526729.690449:0:3281:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788526729.690474:0:3281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c249742d80, transno 4294967307 00000100:00100000:3.0:1788526729.690486:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881559296:0@lo:400:kworker.0 00000100:00100000:0.0:1788526729.690641:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788526729.690652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881559168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526729.690694:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881559168:12345-0@lo:400:kworker.0 Request processed in 45us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526729.690710:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1788526729.690729:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788526729.690734:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526729.691294:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881559168:0@lo:400:kworker.0 00000040:00080000:1.0:1788526730.203338:0:12456:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526730.203348:0:12456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526730.203495:0:12456:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788526730.203503:0:12456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526730.403708:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.403841:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868975616 00000100:00100000:3.0:1788526730.403856:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868975616 00000100:00080000:1.0:1788526730.403929:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526730.403968:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1788526730.403982:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+22:11521:x1875405868975616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526730.404026:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526730.404056:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3ae94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5969f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.404208:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ae9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.404226:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ae9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.404243:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ae9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526730.404256:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788526730.404460:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3ae94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5969f expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.404479:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ae9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5969f expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.404488:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526730.404492:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788526730.404496:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7400, rc 0) 00000100:00100000:3.0:1788526730.405531:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+24:11521:x1875405868975616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1543us (1831us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788526730.405544:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1788526730.408591:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.408710:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868975744 00000100:00100000:0.0:1788526730.408726:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868975744 00000100:00100000:0.0:1788526730.408813:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:0.0:1788526730.408824:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+24:11521:x1875405868975744:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1788526730.408934:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.408958:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.408974:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.408992:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409000:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409019:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409343:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409354:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409374:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526730.409460:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409477:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409485:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409493:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409500:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.409505:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409515:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409529:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526730.409532:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.409537:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409545:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aea9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409558:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409572:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409578:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409583:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.409586:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409593:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409601:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c243972900) 00010000:00010000:0.0:1788526730.409604:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.409607:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409614:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aeb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409632:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409638:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409645:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409650:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.409659:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409666:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409673:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972600) 00010000:00010000:0.0:1788526730.409676:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.409679:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.409684:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.409807:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+24:11521:x1875405868975744:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 971us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526730.409817:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 188 00010000:00010000:2.0:1788526730.453828:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526730.496637:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.497542:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868976000 00000100:00100000:0.0:1788526730.497566:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868976000 00000100:00100000:0.0:1788526730.497663:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:0.0:1788526730.497677:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+24:11524:x1875405868976000:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526730.497709:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526730.497741:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596a6 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497871:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497894:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497934:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497954:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497963:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.497971:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498367:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498378:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498429:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526730.498444:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788526730.498573:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498581:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498589:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498595:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.498608:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498617:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498632:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526730.498635:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.498640:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498648:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3aec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498662:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498669:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498675:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498680:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.498683:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498689:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498697:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c243972600) 00010000:00010000:0.0:1788526730.498699:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.498709:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498715:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821400/0x367645d450b3aecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498771:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 27 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498806:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 26 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.498815:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:0.0:1788526730.498818:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526730.498820:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821800, rc 0) 00000100:00100000:0.0:1788526730.498921:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+26:11524:x1875405868976000:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1247us (2309us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788526730.498940:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:2.0:1788526730.504188:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.504306:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868976128 00000100:00100000:0.0:1788526730.504321:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868976128 00000100:00100000:0.0:1788526730.504529:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:0.0:1788526730.504542:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+26:11524:x1875405868976128:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1788526730.504646:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504669:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504685:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504746:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504754:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504763:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504770:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.504775:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504785:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504811:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:0.0:1788526730.504815:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526730.504821:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.504829:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.505252:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+26:11524:x1875405868976128:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 709us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526730.505261:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:3.0:1788526730.508014:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526730.508221:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868976384 00000100:00100000:1.0:1788526730.508235:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868976384 00000100:00100000:1.0:1788526730.508308:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1788526730.508320:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+26:11524:x1875405868976384:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526730.508818:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+27:11524:x1875405868976384:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 499us (816us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788526730.508827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1788526730.541224:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.541494:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868976640 00000100:00100000:0.0:1788526730.541508:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868976640 00000100:00100000:0.0:1788526730.541592:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:0.0:1788526730.541623:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+27:11048:x1875405868976640:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526730.541658:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526730.541687:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596ad expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.541858:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.541878:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 28 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.541889:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.541937:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 28 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.541954:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 28 pid: 6721 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.541971:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881559552:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526730.542133:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526730.546559:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881559552:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526730.546605:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526730.548720:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.548879:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868976768 00000100:00100000:3.0:1788526730.548893:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868976768 00010000:00010000:3.0:1788526730.548956:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 29 pid: 6721 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526730.549061:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:1.0:1788526730.549140:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+29:2348:x1875405868976768:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526730.549165:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526730.549183:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 29 pid: 6721 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549199:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 29 pid: 6721 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549229:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821800/0x367645d450b3aed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596a6 expref: 29 pid: 6721 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549252:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:1.0:1788526730.549258:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549268:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549353:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.549454:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526730.549665:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+28:2348:x1875405868976768:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 591us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526730.549676:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00010000:00010000:0.0:1788526730.549703:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.549726:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526730.549751:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788526730.555664:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3aee8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.555709:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.555722:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:1.0:1788526730.555744:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526730.555750:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:1.0:1788526730.555856:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+28:11048:x1875405868976640:12345-192.168.204.59@tcp:101:bash.0 Request processed in 14233us (14648us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788526730.555867:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:1.0:1788526730.560352:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.560625:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977024 00000100:00100000:3.0:1788526730.560641:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977024 00000100:00100000:3.0:1788526730.560715:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:3.0:1788526730.560728:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+28:11048:x1875405868977024:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1788526730.561712:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.561739:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.561755:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526730.561833:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788526730.561862:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc7daf54 reply state 000000003854858a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526730.561873:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788526730.561993:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788526730.562265:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+32:11048:x1875405868977024:12345-192.168.204.59@tcp:36:bash.0 Request processed in 1535us (1929us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788526730.562275:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000020:00080000:3.0:1788526730.562282:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788526730.571335:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.572238:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977152 00000100:00100000:3.0:1788526730.572259:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977152 00000100:00100000:3.0:1788526730.572369:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:3.0:1788526730.572383:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+32:11048:x1875405868977152:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526730.572476:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526730.572531:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3af04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596b4 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.572625:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3af04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596b4 expref: 33 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.572644:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3af04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596b4 expref: 33 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.572670:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:3.0:1788526730.572673:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526730.572678:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7c00, rc 0) 00000100:00100000:3.0:1788526730.572767:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+33:11048:x1875405868977152:12345-192.168.204.59@tcp:101:bash.0 Request processed in 386us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526730.572775:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:1.0:1788526730.577801:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.577916:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977280 00000100:00100000:3.0:1788526730.577930:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977280 00000100:00100000:3.0:1788526730.578015:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1788526730.578026:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:11048:x1875405868977280:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526730.578054:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526730.578084:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596bb expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526730.578121:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ac085, atime: 0x6a9ac084, ctime: 0x6a9ac085, blocks: 0xb 00010000:00010000:3.0:1788526730.578152:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788526730.578157:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526730.578166:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.578203:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.578220:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7000, rc 0) 00000100:00100000:3.0:1788526730.578286:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:11048:x1875405868977280:12345-192.168.204.59@tcp:101:bash.0 Request processed in 262us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526730.578293:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00080000:1.0:1788526730.578452:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788526730.581190:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581214:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581223:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581230:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526730.581237:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581246:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581273:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:0.0:1788526730.581277:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526730.581282:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.581288:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3aefd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526730.583679:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.584083:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977408 00000100:00100000:0.0:1788526730.584099:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977408 00002000:00010000:0.0:1788526730.584159:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788526730.584186:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c245220380 with x1875405868977408 ext(0->18446744073709551615) 00002000:00010000:0.0:1788526730.584203:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c245220380. 00000100:00100000:0.0:1788526730.584244:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1788526730.584255:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868977408:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:0.0:1788526730.584770:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788526730.584775:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788526725 -> 1788526729 00002000:00010000:0.0:1788526730.584779:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788526724 -> 1788526724 00002000:00010000:0.0:1788526730.584781:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788526725 -> 1788526729 00002000:00010000:0.0:1788526730.584784:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788526730.589597:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868977408:12345-192.168.204.59@tcp:10:bash.0 Request processed in 5322us (5911us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788526730.589619:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00002000:00010000:0.0:1788526730.589631:0:6676:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788526730.589635:0:6676:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c245220380 with x1875405868977408 ext(0->18446744073709551615) 00002000:00010000:0.0:1788526730.589651:0:6676:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c245220380. 00000100:00100000:2.0:1788526730.667055:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.667188:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977536 00000100:00100000:0.0:1788526730.667204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977536 00000100:00100000:0.0:1788526730.667334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:0.0:1788526730.667353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+32:11538:x1875405868977536:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1788526730.667519:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.667542:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.667565:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.667609:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.667618:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.667630:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668092:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668105:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668114:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788526730.668168:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668182:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668188:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668195:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668201:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.668206:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668224:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668239:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526730.668242:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.668247:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668254:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3af12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668269:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668275:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668281:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668287:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.668289:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668295:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668302:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c243972600) 00010000:00010000:1.0:1788526730.668304:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.668307:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668323:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668340:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668346:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668352:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668357:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.668360:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668367:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668375:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:1.0:1788526730.668377:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.668485:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.668492:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3af20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526730.668603:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+32:11538:x1875405868977536:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1252us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526730.668614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:3.0:1788526730.708879:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881559680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526730.708980:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526730.709215:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881559680 00000100:00100000:1.0:1788526730.709226:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881559680 00000100:00100000:1.0:1788526730.709293:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788526730.709306:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881559680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526730.709359:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526730.709475:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881559680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526730.709483:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788526730.709636:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881559680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526730.720897:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.721057:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977792 00000100:00100000:3.0:1788526730.721071:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977792 00000100:00100000:3.0:1788526730.721155:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:3.0:1788526730.721167:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+32:11541:x1875405868977792:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526730.721198:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526730.721228:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596c2 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721341:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721362:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721490:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721824:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721835:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.721845:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724140:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3af3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724166:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3af3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724180:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3af3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526730.724196:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788526730.724329:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724336:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724344:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724350:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526730.724368:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724377:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724414:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526730.724418:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526730.724424:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724431:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724446:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724452:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724457:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724462:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526730.724465:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724471:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724479:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8b100) 00010000:00010000:3.0:1788526730.724482:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526730.724492:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724498:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724563:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c2 expref: 35 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724579:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3af3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c2 expref: 34 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.724587:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:3.0:1788526730.724590:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788526730.724592:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6600, rc 0) 00000100:00100000:3.0:1788526730.724701:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+34:11541:x1875405868977792:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3534us (3817us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788526730.724711:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:3.0:1788526730.733211:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.733341:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868977920 00000100:00100000:0.0:1788526730.733355:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868977920 00000100:00100000:0.0:1788526730.733479:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:0.0:1788526730.733491:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+34:11541:x1875405868977920:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1788526730.733891:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.733916:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.733928:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.733979:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.733996:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 34 pid: 5824 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.734013:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881559808:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526730.734194:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526730.743034:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881559808:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526730.743084:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526730.752485:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526730.752807:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868978176 00000100:00100000:1.0:1788526730.752822:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868978176 00000100:00100000:1.0:1788526730.752903:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1788526730.752924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:5589:x1875405868978176:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788526730.753888:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+36:5589:x1875405868978176:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 961us (1996us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788526730.753909:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:3.0:1788526730.776899:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.777263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868978304 00000100:00100000:0.0:1788526730.777277:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868978304 00010000:00010000:0.0:1788526730.777333:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 36 pid: 5824 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.777378:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:0.0:1788526730.777440:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+36:2348:x1875405868978304:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526730.777460:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526730.777469:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 36 pid: 5824 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777484:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 36 pid: 5824 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777516:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820400/0x367645d450b3aeef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ad expref: 36 pid: 5824 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777535:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:0.0:1788526730.777541:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777553:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777588:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.777622:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526730.777705:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245222680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+35:2348:x1875405868978304:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 317us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526730.777714:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00010000:00010000:3.0:1788526730.779596:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.779619:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.779669:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.779678:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.779708:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.779715:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526730.779720:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.780037:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.780063:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:3.0:1788526730.780067:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526730.780072:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.780081:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3af4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526730.780494:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+34:11541:x1875405868977920:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 46995us (47290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526730.780582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:2.0:1788526730.783697:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.783800:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868978560 00000100:00100000:3.0:1788526730.783814:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868978560 00000100:00100000:3.0:1788526730.783890:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:3.0:1788526730.783901:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+34:11541:x1875405868978560:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526730.784328:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+35:11541:x1875405868978560:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 426us (645us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788526730.784336:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1788526730.866021:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526730.866249:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868978816 00000100:00100000:1.0:1788526730.866264:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868978816 00000100:00100000:1.0:1788526730.866347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:1.0:1788526730.866360:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+35:11552:x1875405868978816:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1788526730.866446:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526730.866477:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3af51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596c9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866819:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866861:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866876:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866895:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866902:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.866908:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.867879:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3af66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.867895:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3af66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.867918:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3af66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526730.867933:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788526730.868644:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868655:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868662:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868681:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.868687:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868696:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868714:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526730.868717:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.868723:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868730:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3af58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868748:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868754:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868760:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868765:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.868767:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868773:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868803:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c272284600) 00010000:00010000:1.0:1788526730.868805:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.868809:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868814:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3af5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868883:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3af51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c9 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868911:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3af66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c9 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.868920:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:1.0:1788526730.868922:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526730.868925:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110a00, rc 0) 00000100:00100000:1.0:1788526730.869334:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c281e45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+37:11552:x1875405868978816:12345-192.168.204.59@tcp:101:cat.0 Request processed in 2669us (3024us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788526730.869348:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:2.0:1788526730.877543:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526730.877750:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979072 00000100:00100000:1.0:1788526730.877765:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979072 00000100:00100000:1.0:1788526730.877854:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1788526730.877865:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+37:11552:x1875405868979072:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1788526730.878233:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+38:11552:x1875405868979072:12345-192.168.204.59@tcp:35:cat.0 Request processed in 369us (706us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788526730.878242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:2.0:1788526730.905490:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526730.905559:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526730.905594:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526730.905632:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526730.905674:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979584 00000100:00100000:2.0:1788526730.905688:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979584 00000100:00080000:2.0:1788526730.905741:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526730.905795:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979456 00000100:00100000:1.0:1788526730.905801:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979456 00000100:00100000:2.0:1788526730.905815:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:2.0:1788526730.905831:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868979584:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526730.905841:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979328 00000100:00100000:1.0:1788526730.905844:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979328 00000100:00080000:2.0:1788526730.905872:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526730.905880:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1788526730.905890:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+9:2351:x1875405868979456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526730.905965:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+9:2351:x1875405868979456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 76us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526730.905973:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1788526730.905996:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:1.0:1788526730.906003:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868979328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526730.906026:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868979328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526730.906032:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1788526730.906118:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979200 00000100:00100000:3.0:1788526730.906123:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979200 00000100:00100000:3.0:1788526730.906167:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 324 00000100:00100000:3.0:1788526730.906175:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868979200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526730.906209:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868979200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526730.906216:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 324 00000100:00100000:2.0:1788526730.908400:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868979584:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 2546us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526730.908419:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:2.0:1788526730.922026:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.924192:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868979840 00000100:00100000:3.0:1788526730.924217:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868979840 00000100:00100000:3.0:1788526730.924327:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 198 00000100:00100000:3.0:1788526730.924342:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+38:11553:x1875405868979840:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:3.0:1788526730.924455:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788526730.924495:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3af66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c9 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924526:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3af3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596c2 expref: 37 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924540:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3af04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596b4 expref: 36 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924553:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c243972900) 00010000:00010000:3.0:1788526730.924568:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526730.924600:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924617:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924650:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924668:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924675:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.924682:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.925115:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.925126:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.925134:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526730.926321:0:6721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788526730.926340:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366266952080ns, next at 367266948828ns, rc = 0 00010000:00010000:3.0:1788526730.929588:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929619:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929633:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929666:0:6721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929673:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929679:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929712:0:6721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526730.929747:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929754:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929761:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929768:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526730.929774:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929792:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929809:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b000) 00010000:00010000:3.0:1788526730.929812:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788526730.929819:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929837:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3af82 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929870:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929876:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929882:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929886:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526730.929890:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929897:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929906:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526730.929908:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526730.929911:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.929917:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3af74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526730.929929:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000789e0b47 reply state 00000000b69eca32 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526730.929939:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788526730.930088:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+37:11553:x1875405868979840:12345-192.168.204.59@tcp:36:rm.0 Request processed in 5742us (8072us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788526730.930101:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 198 00010000:00010000:1.0:1788526730.930645:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526730.930654:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.930663:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526730.930667:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.930675:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.930686:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98c242a8b000) 00010000:00010000:1.0:1788526730.930689:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788526730.930692:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.930708:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3af89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.930730:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526730.930732:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526730.930734:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526730.941643:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941672:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941682:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941689:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526730.941695:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941705:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941730:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8b100) 00010000:00010000:2.0:1788526730.941900:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526730.941908:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.941915:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3af7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526730.978874:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.979629:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980096 00000100:00100000:3.0:1788526730.979646:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980096 00000100:00100000:2.0:1788526730.981301:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:2.0:1788526730.981330:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+36:11559:x1875405868980096:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526730.981374:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526730.981429:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3af90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596d0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981658:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981677:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981690:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981838:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981848:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.981856:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526730.984029:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788526730.984501:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984524:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984538:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984587:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984596:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984603:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984610:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526730.984615:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984625:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984641:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526730.984644:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526730.984650:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984674:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3af97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788526730.984691:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fafbaae5 reply state 00000000aa749da7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526730.984702:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788526730.984936:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3af90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984956:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526730.984965:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:2.0:1788526730.984967:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526730.984970:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76400, rc 0) 00000100:00100000:2.0:1788526730.985085:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+39:11559:x1875405868980096:12345-192.168.204.59@tcp:101:bash.0 Request processed in 3769us (6228us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788526730.985095:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 199 00010000:00010000:1.0:1788526730.987367:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987429:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987504:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987512:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526730.987518:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987529:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987552:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c260d60900) 00010000:00010000:1.0:1788526730.987556:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526730.987562:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526730.987569:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3af9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526730.991576:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526730.991909:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980224 00000100:00100000:3.0:1788526730.991923:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980224 00000100:00100000:3.0:1788526730.992007:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1788526730.992019:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868980224:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526730.992045:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526730.992074:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596d7 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526730.992107:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526730.992134:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1788526730.992139:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526730.992335:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.992367:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 6 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526730.992462:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6a00, rc 0) 00000100:00100000:3.0:1788526730.992599:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+6:2348:x1875405868980224:12345-192.168.204.59@tcp:101:bash.0 Request processed in 582us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526730.992607:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1788526730.996210:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526730.997041:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980352 00000100:00100000:0.0:1788526730.997061:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980352 00000100:00100000:0.0:1788526730.997149:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1788526730.997162:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+6:11559:x1875405868980352:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1788526730.997188:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526730.997216:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596de expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.997260:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.997270:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526730.997276:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526730.997282:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.997328:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526730.997364:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526730.997380:0:6670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881559936:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526730.997576:0:6670:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526731.001533:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526731.001994:0:6670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6670:1875405881559936:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526731.002054:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.002083:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:0.0:1788526731.002167:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:11559:x1875405868980352:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5007us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526731.002178:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1788526731.002352:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980480 00000100:00100000:3.0:1788526731.002363:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980480 00010000:00010000:3.0:1788526731.002454:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.002496:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1788526731.002508:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868980480:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526731.002528:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526731.002560:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.002575:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.002604:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3afb3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d7 expref: 7 pid: 8450 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.002622:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526731.002627:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526731.002637:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.002649:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.002689:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.002727:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881560064:192.168.204.59@tcp:105: 00000100:00100000:3.0:1788526731.002817:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526731.010323:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5808:1875405881560064:192.168.204.59@tcp:105: 00010000:00010000:3.0:1788526731.010363:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526731.010492:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+6:2349:x1875405868980480:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 7984us (8971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.010506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:2.0:1788526731.015691:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.015970:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980736 00000100:00100000:1.0:1788526731.016007:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980736 00000100:00100000:1.0:1788526731.016131:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1788526731.016145:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+38:11559:x1875405868980736:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:1.0:1788526731.017059:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+39:11559:x1875405868980736:12345-192.168.204.59@tcp:35:bash.0 Request processed in 909us (1377us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788526731.017073:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:2.0:1788526731.209071:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.209204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868980864 00000100:00100000:1.0:1788526731.209219:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868980864 00000100:00100000:1.0:1788526731.209306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:1.0:1788526731.209319:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+39:11575:x1875405868980864:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526731.209354:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526731.209443:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3afc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596e5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209542:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209560:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209574:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526731.209620:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788526731.209624:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526731.209646:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209677:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3afc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596e5 expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209720:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596e5 expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.209731:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526731.209735:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526731.209740:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110600, rc 0) 00000100:00100000:1.0:1788526731.209838:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+40:11575:x1875405868980864:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 520us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.209846:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:2.0:1788526731.218947:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.219051:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981120 00000100:00100000:3.0:1788526731.219066:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981120 00000100:00100000:3.0:1788526731.219152:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:3.0:1788526731.219163:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+40:11575:x1875405868981120:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526731.219193:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526731.219224:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3afcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596ec expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.219816:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3afd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.219836:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3afd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.219851:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3afd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526731.219866:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788526731.220044:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3afcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ec expref: 43 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.220076:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3afd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ec expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.220086:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:3.0:1788526731.220090:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526731.220094:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7600, rc 0) 00000100:00100000:3.0:1788526731.220229:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+42:11575:x1875405868981120:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1067us (1297us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788526731.220238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:2.0:1788526731.225462:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.225625:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981376 00000100:00100000:1.0:1788526731.225640:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981376 00000100:00100000:1.0:1788526731.225716:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:1.0:1788526731.225729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+42:11575:x1875405868981376:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526731.225767:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526731.225816:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3afe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596f3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.225986:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.226006:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.226021:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526731.226036:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788526731.226246:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3afe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596f3 expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.226270:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596f3 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.226281:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:1.0:1788526731.226284:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788526731.226289:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110400, rc 0) 00000100:00100000:1.0:1788526731.226377:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+44:11575:x1875405868981376:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 650us (930us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788526731.226445:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:0.0:1788526731.234360:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.235738:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981504 00000100:00100000:1.0:1788526731.235758:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981504 00000100:00100000:1.0:1788526731.235857:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526731.235870:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+44:2351:x1875405868981504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526731.235902:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526731.235936:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3afd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596ec expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.235957:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:1.0:1788526731.235963:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526731.236036:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+43:2351:x1875405868981504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 169us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.236045:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1788526731.241684:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526731.241837:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981632 00000100:00100000:0.0:1788526731.241855:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981632 00000100:00100000:0.0:1788526731.241950:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1788526731.241964:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+6:2350:x1875405868981632:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:0.0:1788526731.242030:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.242058:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.242094:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526731.242100:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526731.242107:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.242162:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.242179:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 6 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526731.242198:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875405881560192:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526731.242332:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526731.247309:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.247655:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981760 00000100:00100000:3.0:1788526731.247670:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981760 00002000:00100000:3.0:1788526731.247752:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98c274725c00 x1875405868981760/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:447/0 lens 504/0 e 0 to 0 dl 1788526742 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526731.247765:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274725c00 with x1875405868981760 ext(0->8) 00010000:00010000:3.0:1788526731.247790:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 7 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.247812:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 7 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526731.247822:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c274725c00 00000100:00100000:3.0:1788526731.247884:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1788526731.247896:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868981760:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:3.0:1788526731.248958:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868981760:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 1058us (1658us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788526731.248976:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:3.0:1788526731.248987:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98c274725c00 x1875405868981760/t4294967308(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:447/0 lens 504/448 e 0 to 0 dl 1788526742 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526731.248997:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274725c00 with x1875405868981760 ext(0->8) 00010000:00010000:3.0:1788526731.249006:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.249022:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526731.249031:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98c274725c00 00000100:00100000:0.0:1788526731.249241:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6671:1875405881560192:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526731.249278:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.256249:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.257624:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868981888 00000100:00100000:3.0:1788526731.257641:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868981888 00010000:00010000:3.0:1788526731.257711:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.257772:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:3.0:1788526731.257796:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+9:2351:x1875405868981888:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526731.257819:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788526731.257860:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788526731.257864:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788526730 00002000:00010000:3.0:1788526731.257867:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788526730 00002000:00010000:3.0:1788526731.257869:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788526730 00010000:00010000:3.0:1788526731.257878:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.257929:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.257960:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006099947c/0x367645d450b3afba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596de expref: 9 pid: 6670 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.257982:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526731.257987:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526731.257995:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.258007:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.258570:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526731.258666:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2351:x1875405868981888:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 870us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.258676:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00010000:00010000:0.0:1788526731.263186:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263214:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263270:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263306:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263317:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263325:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526731.263331:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.263341:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.265068:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.265092:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3aff9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526731.265241:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+7:2350:x1875405868981632:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 23274us (23567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526731.265254:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1788526731.280614:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.281050:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868982144 00000100:00100000:3.0:1788526731.281066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868982144 00000100:00100000:3.0:1788526731.281164:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1788526731.281178:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+43:11575:x1875405868982144:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:3.0:1788526731.281275:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596f3 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526731.281932:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788526731.281989:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788526731.283039:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788526731.283145:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.283171:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.283182:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.283234:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.283256:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 47 pid: 5822 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.283275:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881560320:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526731.283770:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526731.298642:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526731.299113:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868982272 00000100:00100000:0.0:1788526731.299128:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868982272 00010000:00010000:0.0:1788526731.299193:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 48 pid: 5822 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526731.299263:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:0.0:1788526731.299276:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+48:2348:x1875405868982272:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526731.299298:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526731.299307:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 48 pid: 5822 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.299321:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 48 pid: 5822 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.299349:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:0.0:1788526731.299357:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.299368:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.299377:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.299445:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526731.299511:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+48:2348:x1875405868982272:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 237us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526731.299520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00010000:00010000:3.0:1788526731.300291:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3afa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596d0 expref: 47 pid: 5822 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.300317:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5825:1875405881560320:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526731.300350:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.300377:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.300383:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526731.300623:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788526731.301247:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788526731.302133:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881560448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788526731.302453:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526731.302555:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788526731.306025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881560448 00000100:00100000:0.0:1788526731.306050:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881560448 00000100:00100000:1.0:1788526731.306265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788526731.306280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881560448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788526731.306519:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881560448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 242us (4065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.306528:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526731.306742:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881560448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788526731.307449:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788526731.307575:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881560576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788526731.307642:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526731.307672:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526731.308202:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881560576 00000100:00100000:0.0:1788526731.308212:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881560576 00000100:00100000:0.0:1788526731.308274:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788526731.308284:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1875405881560576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788526731.308600:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1875405881560576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 317us (956us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788526731.308608:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788526731.308921:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526731.309093:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5825:1875405881560576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788526731.309186:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788526731.309248:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309261:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309271:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309278:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526731.309285:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309307:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309330:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:3.0:1788526731.309332:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788526731.309338:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.309345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b000 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788526731.310121:0:5825:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788526731.310245:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788526731.310258:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366650870871ns, next at 367650868316ns, rc = 0 00000001:00080000:3.0:1788526731.310267:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788526731.310312:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c260d60200) 00010000:00010000:3.0:1788526731.310316:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788526731.310326:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3afeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596f3 expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.311015:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+50:11575:x1875405868982144:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 29838us (30413us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788526731.311027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000020:00080000:3.0:1788526731.311033:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788526731.315790:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.316060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868982400 00000100:00100000:3.0:1788526731.316075:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868982400 00000100:00100000:3.0:1788526731.316157:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:3.0:1788526731.316170:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+50:11575:x1875405868982400:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526731.316232:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526731.316268:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3b007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc596fa expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.316362:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3b007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596fa expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.316381:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3b007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596fa expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.316466:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526731.316470:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526731.316475:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7c00, rc 0) 00000100:00100000:3.0:1788526731.316564:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:11575:x1875405868982400:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 397us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.316571:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:2.0:1788526731.320628:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.324019:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868982656 00000100:00100000:1.0:1788526731.324044:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868982656 00000100:00100000:1.0:1788526731.324165:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1788526731.324181:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+51:11575:x1875405868982656:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526731.324580:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+52:11575:x1875405868982656:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 402us (3966us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788526731.324589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:0.0:1788526731.426486:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.427552:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868982784 00000100:00100000:1.0:1788526731.427573:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868982784 00000100:00100000:1.0:1788526731.427697:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:1.0:1788526731.427710:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+52:11585:x1875405868982784:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1788526731.427856:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.427883:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.427898:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.427919:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.427927:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.427969:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428114:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428123:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428130:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788526731.428190:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428206:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428213:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428221:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428228:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.428234:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428243:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428258:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526731.428269:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526731.428278:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428285:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b00e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428306:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428312:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428318:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428324:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.428326:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428332:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428339:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c272284600) 00010000:00010000:1.0:1788526731.428343:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526731.428345:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428351:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b015 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428370:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428382:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428500:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428505:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.428508:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428514:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428522:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526731.428525:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526731.428529:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.428534:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b01c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.428675:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+52:11585:x1875405868982784:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 966us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.428684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 204 00010000:00010000:0.0:1788526731.475975:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526731.489708:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.490709:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868983040 00000100:00100000:3.0:1788526731.490729:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868983040 00000100:00100000:3.0:1788526731.490836:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:3.0:1788526731.490848:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+52:11588:x1875405868983040:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526731.490876:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526731.490908:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59701 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491015:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491036:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491072:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491093:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491100:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491107:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491277:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491287:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491294:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526731.491307:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788526731.491508:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491518:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491526:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491532:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526731.491545:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491555:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491570:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526731.491573:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526731.491578:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491586:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b02a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491603:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491608:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491615:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491620:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526731.491623:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491629:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491637:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8bf00) 00010000:00010000:3.0:1788526731.491639:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526731.491649:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491655:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491711:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491728:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.491735:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526731.491737:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526731.491740:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7600, rc 0) 00000100:00100000:3.0:1788526731.491845:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:11588:x1875405868983040:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 999us (2165us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788526731.491854:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:0.0:1788526731.494516:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.494632:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868983168 00000100:00100000:1.0:1788526731.494647:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868983168 00000100:00100000:1.0:1788526731.495119:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:1.0:1788526731.495133:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:11588:x1875405868983168:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1788526731.495236:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495276:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495291:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495326:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495334:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495342:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495348:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.495353:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495362:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495376:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526731.495380:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526731.495420:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.495429:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.496939:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+54:11588:x1875405868983168:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 1794us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.496976:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:0.0:1788526731.510889:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526731.511607:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868983424 00000100:00100000:2.0:1788526731.511623:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868983424 00000100:00100000:2.0:1788526731.511710:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1788526731.511723:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+54:11588:x1875405868983424:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1788526731.512241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:11588:x1875405868983424:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 518us (1362us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788526731.512250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1788526731.604515:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.607839:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868983680 00000100:00100000:3.0:1788526731.607864:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868983680 00000100:00100000:2.0:1788526731.611225:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:2.0:1788526731.611245:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:11598:x1875405868983680:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526731.611283:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526731.611287:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788526731.611328:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3afc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596e5 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.611354:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526731.611360:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526731.611378:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b04d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59708 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.611915:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.611932:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.611943:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.611988:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.612004:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 55 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.612020:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875405881560704:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526731.612150:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2461e6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788526731.615267:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.615356:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868983808 00000100:00100000:3.0:1788526731.615370:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868983808 00010000:00010000:3.0:1788526731.615462:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 56 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.615512:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1788526731.615525:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:2349:x1875405868983808:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526731.615547:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526731.615555:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 56 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.615590:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 56 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.615621:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526731.615628:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.615640:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.615649:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.615674:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526731.616113:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+56:2349:x1875405868983808:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 244us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.616125:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00010000:00010000:2.0:1788526731.616487:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7600/0x367645d450b3b038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59701 expref: 55 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.616509:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274726a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875405881560704:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526731.616536:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.616547:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.616569:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526731.616595:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788526731.616974:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b04d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.616993:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.617003:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526731.617006:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788526731.617009:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77e00, rc 0) 00000100:00100000:2.0:1788526731.617068:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+55:11598:x1875405868983680:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5827us (12686us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788526731.617077:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:0.0:1788526731.620109:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.620279:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984064 00000100:00100000:3.0:1788526731.620294:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984064 00000100:00100000:3.0:1788526731.620374:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 208 00000100:00100000:3.0:1788526731.620433:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+55:11598:x1875405868984064:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1788526731.621117:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.621142:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.621157:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526731.621248:0:6721:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788526731.621281:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888bfbf6 reply state 00000000307b50b5 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.621292:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788526731.621507:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+58:11598:x1875405868984064:12345-192.168.204.59@tcp:36:bash.0 Request processed in 1120us (1409us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788526731.621518:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 208 00000020:00080000:3.0:1788526731.621524:0:6721:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788526731.635211:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.635548:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984192 00000100:00100000:3.0:1788526731.635564:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984192 00010000:00010000:2.0:1788526731.635612:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.635629:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.635638:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.635645:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1f6a4f0) 00000100:00100000:3.0:1788526731.635648:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 209 00010000:00010000:2.0:1788526731.635653:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.635662:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:11598:x1875405868984192:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526731.635685:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.635697:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526731.635707:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526731.635712:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526731.635718:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.635725:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b062 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.635740:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5970f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.635877:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.636093:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.636106:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.636154:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.636187:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 58 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.636209:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881560832:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526731.636326:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526731.642460:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.643190:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881560832:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526731.643232:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.644162:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984320 00000100:00100000:2.0:1788526731.644177:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984320 00010000:00010000:2.0:1788526731.644240:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 59 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.644361:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1788526731.644383:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+59:2349:x1875405868984320:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526731.644609:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526731.644619:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 59 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644636:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 59 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644666:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77e00/0x367645d450b3b054 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59708 expref: 59 pid: 5823 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644724:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526731.644731:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644744:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644752:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.644810:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526731.644843:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.644855:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526731.644941:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1788526731.644948:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+58:2349:x1875405868984320:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 565us (2505us total) trans 0 rc 0/0 00000004:00200000:0.0:1788526731.644950:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788526731.644962:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000004:00010000:0.0:1788526731.644981:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.645023:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6000/0x367645d450b3b069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.645040:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526731.645062:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:0.0:1788526731.645065:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526731.645068:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6600, rc 0) 00000100:00100000:0.0:1788526731.645101:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:11598:x1875405868984192:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9442us (9905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526731.645110:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:0.0:1788526731.650076:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.650260:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984576 00000100:00100000:3.0:1788526731.650276:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984576 00000100:00100000:3.0:1788526731.650447:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1788526731.650461:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+57:11598:x1875405868984576:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1788526731.650812:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+58:11598:x1875405868984576:12345-192.168.204.59@tcp:35:bash.0 Request processed in 353us (758us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788526731.650820:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1788526731.738866:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.738991:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984704 00000100:00100000:1.0:1788526731.739007:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984704 00000100:00100000:1.0:1788526731.739079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:1.0:1788526731.739091:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+58:11604:x1875405868984704:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526731.739127:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526731.739158:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59716 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739283:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739302:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739319:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526731.739381:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788526731.739428:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526731.739454:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739488:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59716 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739512:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59716 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.739537:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526731.739541:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526731.739546:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111000, rc 0) 00000100:00100000:1.0:1788526731.739633:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868984704:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 544us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.739641:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:0.0:1788526731.742889:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.743751:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868984832 00000100:00100000:1.0:1788526731.743778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868984832 00000100:00100000:1.0:1788526731.743861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:1.0:1788526731.743874:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868984832:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526731.743903:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526731.743931:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5971d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744018:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744039:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744054:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744072:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744080:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744111:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744229:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744238:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744246:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526731.744295:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788526731.744301:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526731.744324:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744339:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744348:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744369:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.744378:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745284:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.745299:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745341:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745852:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526731.745858:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526731.745866:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b08c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745900:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745907:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745915:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745922:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526731.745926:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745933:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745940:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c272284600) 00010000:00010000:1.0:1788526731.745943:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526731.745946:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.745965:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b093 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.746037:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.746058:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.746066:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526731.746069:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526731.746071:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111800, rc 0) 00000100:00100000:1.0:1788526731.746282:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:11604:x1875405868984832:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2409us (3408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526731.746293:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:0.0:1788526731.752128:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526731.753178:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985088 00000100:00100000:1.0:1788526731.753197:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985088 00000100:00100000:1.0:1788526731.753299:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:1.0:1788526731.753313:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+60:11604:x1875405868985088:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526731.753344:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526731.753415:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b0a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59724 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753565:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753585:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753615:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753626:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526731.753666:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1788526731.753675:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753691:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.753710:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881560960:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526731.753743:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985216 00000100:00100000:3.0:1788526731.753749:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985216 00010000:00010000:3.0:1788526731.753785:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 62 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526731.753812:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1788526731.753819:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+62:2349:x1875405868985216:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526731.753850:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526731.753854:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.753861:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 62 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.753864:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 62 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.753873:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b574000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881561088:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526731.753877:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 62 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.753899:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788526731.753912:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526731.753917:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.753925:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.753932:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526731.753963:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+62:2349:x1875405868985216:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 145us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.753972:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:0.0:1788526731.758812:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526731.758919:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985344 00000100:00100000:2.0:1788526731.758934:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985344 00010000:00010000:2.0:1788526731.759006:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 62 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526731.759073:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:2.0:1788526731.759086:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+62:2348:x1875405868985344:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526731.759110:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526731.759119:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 62 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.759136:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 62 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.759193:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526731.759199:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.759211:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.759220:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.759246:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526731.759327:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+62:2348:x1875405868985344:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 243us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526731.759336:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00010000:00010000:1.0:1788526731.760602:0:5824:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.59@tcp) returned -22 from blocking AST (req@00000000a8bb84d7 x1875405881560960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.760629:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b09a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5971d expref: 61 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.760664:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881560960:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526731.760686:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6600/0x367645d450b3b070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5970f expref: 60 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526731.760696:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b574000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881561088:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526731.760726:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526731.760736:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.760748:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.760755:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526731.760794:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788526731.761192:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110800/0x367645d450b3b0a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.761211:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526731.761219:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526731.761222:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526731.761225:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110400, rc 0) 00000100:00100000:1.0:1788526731.761379:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+60:11604:x1875405868985088:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 8069us (9268us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788526731.761448:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:0.0:1788526731.765200:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.765305:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985600 00000100:00100000:3.0:1788526731.765320:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985600 00000100:00100000:2.0:1788526731.765537:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1788526731.765556:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+60:11604:x1875405868985600:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:2.0:1788526731.765578:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526731.765617:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7c00/0x367645d450b3b007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596fa expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526731.765641:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526731.765648:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526731.765719:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868985600:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 169us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526731.765728:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1788526731.768363:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.768832:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985728 00000100:00100000:3.0:1788526731.768846:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985728 00000100:00100000:3.0:1788526731.768997:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:3.0:1788526731.769010:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868985728:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:3.0:1788526731.769261:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.769284:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.769299:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526731.769741:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788526731.769878:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868985728:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 869us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.771481:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:0.0:1788526731.773814:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526731.774150:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985856 00000100:00100000:3.0:1788526731.774164:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985856 00000100:00100000:3.0:1788526731.774295:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:3.0:1788526731.774309:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+59:11604:x1875405868985856:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526731.774337:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526731.774366:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5972b expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774496:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774509:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774535:0:6721:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774552:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774568:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526731.774571:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526731.774576:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 60 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526731.774604:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6e00, rc 0) 00000100:00100000:3.0:1788526731.774678:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+60:11604:x1875405868985856:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 373us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526731.774687:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00000040:00080000:0.0:1788526732.244114:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788526732.244130:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788526732.245754:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788526732.245786:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788526732.247100:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881561216:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788526732.248108:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.262592:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.268599:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881561216:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788526732.268946:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868985984 00000100:00100000:2.0:1788526732.268958:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868985984 00000100:00100000:2.0:1788526732.269086:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:2.0:1788526732.269100:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:11605:x1875405868985984:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788526732.269144:0:5823:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788526732.269304:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+60:11605:x1875405868985984:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 206us (6733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.269314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00080000:0.0:1788526732.269542:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526732.275744:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.275907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868986112 00000100:00100000:1.0:1788526732.275923:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868986112 00000100:00100000:1.0:1788526732.276009:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:1.0:1788526732.276022:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+60:11605:x1875405868986112:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788526732.276129:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276151:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276165:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276182:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276189:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276195:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276237:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276247:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276274:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526732.276323:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788526732.276328:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526732.276344:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276358:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276365:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276373:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276379:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.276427:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276437:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276451:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:1.0:1788526732.276454:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526732.276460:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276467:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111800/0x367645d450b3b0c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276499:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276505:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276511:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276517:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.276520:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276526:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276534:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98c272284600) 00010000:00010000:1.0:1788526732.276537:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526732.276541:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276547:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b0cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276566:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276573:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276578:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276594:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.276597:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276604:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276613:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526732.276616:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526732.276619:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.276624:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110600/0x367645d450b3b0d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.276724:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+60:11605:x1875405868986112:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 702us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526732.276733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:1.0:1788526732.283751:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.284111:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868986368 00000100:00100000:2.0:1788526732.284125:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868986368 00000100:00100000:3.0:1788526732.284467:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:3.0:1788526732.284483:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+60:11605:x1875405868986368:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.284512:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526732.284542:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b0d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59732 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284682:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284701:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284714:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526732.284727:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788526732.284872:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284881:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284888:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284916:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526732.284921:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284930:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284944:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526732.284947:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788526732.284953:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.284960:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b0e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.285015:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b0d9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59732 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.285027:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:3.0:1788526732.285029:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526732.285034:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b0d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59732 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.285044:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6800, rc 0) 00000100:00100000:3.0:1788526732.285566:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868986368:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1083us (1828us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788526732.285575:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:0.0:1788526732.293013:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.294633:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868986496 00000100:00100000:3.0:1788526732.294692:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868986496 00000100:00100000:3.0:1788526732.294789:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:3.0:1788526732.294802:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868986496:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788526732.294853:0:6721:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788526732.295001:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868986496:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 202us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.295010:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:0.0:1788526732.300593:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.300742:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868986752 00000100:00100000:2.0:1788526732.300768:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868986752 00000100:00100000:2.0:1788526732.300861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:2.0:1788526732.300882:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868986752:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526732.300915:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526732.300919:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788526732.300959:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111000/0x367645d450b3b07e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59716 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.300986:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:2.0:1788526732.300993:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526732.301013:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b0ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59739 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526732.301653:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788526732.301932:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.301951:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.301983:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.302053:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b0ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59739 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.302071:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59739 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.302081:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:2.0:1788526732.302084:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526732.302087:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76200, rc 0) 00000100:00100000:2.0:1788526732.302184:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+62:11605:x1875405868986752:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1313us (1608us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788526732.302193:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:0.0:1788526732.310784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.311227:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987008 00000100:00100000:3.0:1788526732.311243:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987008 00000100:00100000:3.0:1788526732.311328:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:3.0:1788526732.311342:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+62:11605:x1875405868987008:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.311493:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526732.311538:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76200/0x367645d450b3b0f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59739 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311568:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60d00) 00010000:00010000:3.0:1788526732.311584:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526732.311617:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311636:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311647:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311665:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311691:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311699:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311806:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311815:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311823:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.311831:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526732.312272:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312284:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312295:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:3.0:1788526732.312299:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526732.312303:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312310:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b103 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312322:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312335:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312342:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312347:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526732.312350:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312356:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312362:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x171119dc (ffff98c242a8bf00) 00010000:00010000:3.0:1788526732.312364:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526732.312366:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.312372:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b10a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x171119dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.312855:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868987008:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1511us (2082us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788526732.312864:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:1.0:1788526732.320221:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.320326:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987136 00000100:00100000:2.0:1788526732.320341:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987136 00000100:00100000:2.0:1788526732.320523:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:2.0:1788526732.320536:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+61:11605:x1875405868987136:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526732.320567:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526732.320601:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b111 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59740 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.320650:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.320668:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.320704:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.321239:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77000/0x367645d450b3b111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.321265:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.321276:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:2.0:1788526732.321279:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788526732.321283:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77600, rc 0) 00000100:00100000:2.0:1788526732.321520:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+62:11605:x1875405868987136:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 987us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.321529:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:0.0:1788526732.330092:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.330304:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987392 00000100:00100000:1.0:1788526732.330319:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987392 00000100:00100000:1.0:1788526732.330454:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:1.0:1788526732.330467:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+62:11605:x1875405868987392:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526732.330608:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.330633:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.330675:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526732.334150:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788526732.334176:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367674788747ns, next at 368674782797ns, rc = 0 00000004:00010000:1.0:1788526732.334345:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f654b91 reply state 00000000a1f6bf16 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.334359:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526732.334575:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+64:11605:x1875405868987392:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 4104us (4493us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788526732.334586:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00010000:00010000:1.0:1788526732.342571:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342598:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342607:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342615:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.342621:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342632:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342657:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:1.0:1788526732.342661:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526732.342695:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.342703:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110e00/0x367645d450b3b11f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526732.346461:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.346803:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987520 00000100:00100000:3.0:1788526732.346821:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987520 00000100:00100000:3.0:1788526732.346910:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:3.0:1788526732.346924:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+63:11605:x1875405868987520:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.346964:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526732.347018:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59747 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.347120:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 64 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.347139:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 64 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.347167:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526732.347171:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526732.347176:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7800, rc 0) 00000100:00100000:3.0:1788526732.347264:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+64:11605:x1875405868987520:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 342us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.347272:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:0.0:1788526732.365159:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.365308:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987648 00000100:00100000:3.0:1788526732.365321:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987648 00000100:00100000:3.0:1788526732.365439:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1788526732.365452:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+9:2349:x1875405868987648:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788526732.366257:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e67ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+10:2349:x1875405868987648:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 803us (1108us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788526732.366268:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00080000:0.0:1788526732.366833:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788526732.382300:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.382439:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868987904 00000100:00100000:2.0:1788526732.382453:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868987904 00000100:00100000:2.0:1788526732.382530:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1788526732.382542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+64:11605:x1875405868987904:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788526732.382870:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+65:11605:x1875405868987904:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 330us (589us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788526732.382879:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1788526732.386968:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.387077:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988160 00000100:00100000:3.0:1788526732.387092:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988160 00000100:00100000:3.0:1788526732.387168:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:3.0:1788526732.387180:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+65:11605:x1875405868988160:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788526732.387341:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+65:11605:x1875405868988160:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 163us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.387370:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:0.0:1788526732.391178:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.393173:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988288 00000100:00100000:3.0:1788526732.393196:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988288 00000100:00100000:3.0:1788526732.393296:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 225 00000100:00100000:3.0:1788526732.393309:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+65:11605:x1875405868988288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.393342:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526732.393808:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b12d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5974e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.394148:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.394166:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.394181:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526732.394228:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526732.394970:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.395018:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b12d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5974e expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.395042:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5974e expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.395053:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526732.395069:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788526732.395075:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7e00, rc 0) 00000100:00100000:3.0:1788526732.395171:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+66:11605:x1875405868988288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1864us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.395181:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 225 00000100:00100000:0.0:1788526732.400612:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.401021:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988416 00000100:00100000:3.0:1788526732.401034:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988416 00000100:00100000:3.0:1788526732.401107:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1788526732.401118:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+10:2348:x1875405868988416:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.401142:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526732.401169:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59755 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526732.401204:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac08b, blocks: 0x1 00010000:00010000:3.0:1788526732.401226:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788526732.401232:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526732.401241:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.401264:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 11 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.401281:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6800, rc 0) 00000100:00100000:3.0:1788526732.401343:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+11:2348:x1875405868988416:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 228us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.401350:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1788526732.408546:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.408684:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988672 00000100:00100000:3.0:1788526732.408699:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988672 00000100:00100000:3.0:1788526732.408790:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:3.0:1788526732.408802:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+66:11605:x1875405868988672:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788526732.408939:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+66:11605:x1875405868988672:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.408947:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:1.0:1788526732.417841:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526732.417951:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988800 00000100:00100000:0.0:1788526732.417966:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988800 00000100:00100000:0.0:1788526732.418058:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:0.0:1788526732.418072:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+11:11605:x1875405868988800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526732.418102:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526732.418132:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5975c expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.418192:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 12 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.418204:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526732.418209:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526732.418216:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.418267:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 12 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.418286:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 12 pid: 6670 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526732.418328:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881561344:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526732.418764:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.435898:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.436794:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868988928 00000100:00100000:1.0:1788526732.436814:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868988928 00010000:00010000:1.0:1788526732.436882:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 13 pid: 6670 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.436941:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:1.0:1788526732.436954:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868988928:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526732.436982:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526732.437018:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 13 pid: 6670 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.437033:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 13 pid: 6670 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.437069:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526732.437075:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526732.437086:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.437099:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.437174:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.437194:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1875405881561472:192.168.204.59@tcp:105: 00000100:00100000:1.0:1788526732.437323:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788526732.443530:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b13b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59755 expref: 13 pid: 6670 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.443564:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6671:1875405881561344:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526732.443608:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.444294:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820200, rc 0) 00000100:00100000:3.0:1788526732.447943:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+12:11605:x1875405868988800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 29856us (30099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.447959:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1788526732.453225:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b575f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5809:1875405881561472:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526732.453273:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526732.453355:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+11:2349:x1875405868988928:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 16402us (17471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526732.453369:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1788526732.481566:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.483527:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989056 00000100:00100000:3.0:1788526732.483549:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989056 00002000:00100000:3.0:1788526732.483653:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98c2746c3480 x1875405868989056/t0(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:448/0 lens 504/0 e 0 to 0 dl 1788526743 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788526732.483678:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c2746c3480 with x1875405868989056 ext(0->12) 00002000:00010000:3.0:1788526732.483686:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c2746c3480 00000100:00100000:3.0:1788526732.483737:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1788526732.483775:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+11:2349:x1875405868989056:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788526732.486806:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:2349:x1875405868989056:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 3011us (5235us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788526732.486845:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00002000:00100000:2.0:1788526732.486863:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98c2746c3480 x1875405868989056/t4294967320(0) o4->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:448/0 lens 504/448 e 0 to 0 dl 1788526743 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788526732.486874:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c2746c3480 with x1875405868989056 ext(0->12) 00002000:00010000:2.0:1788526732.486883:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c2746c3480 00000100:00100000:2.0:1788526732.493565:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:3.0:1788526732.500379:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526732.502345:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989184 00000100:00100000:1.0:1788526732.502366:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989184 00000100:00100000:1.0:1788526732.503168:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:1.0:1788526732.503184:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+66:11605:x1875405868989184:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788526732.565162:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967470 is committed 00000020:00080000:0.0:1788526732.565192:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1788526732.565216:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1788526732.565223:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788526732.565514:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788526732.565529:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788526732.565675:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881561600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788526732.565778:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526732.566108:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526732.566116:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881561728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788526732.566145:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526732.566192:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881561600 00000100:00100000:3.0:1788526732.566202:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881561600 00000100:00100000:3.0:1788526732.566271:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881561728 00000100:00100000:3.0:1788526732.566274:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881561728 00000100:00100000:3.0:1788526732.566297:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788526732.566307:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881561600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788526732.566343:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788526732.566378:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.566594:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788526732.566606:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881561728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788526732.566831:0:12011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788526732.566835:0:12011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788526731 00002000:00010000:1.0:1788526732.566837:0:12011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788526732.566840:0:12011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788526731 -> 1788526731 00002000:00010000:1.0:1788526732.566842:0:12011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788526732.566922:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3280:x1875405881561728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (775us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788526732.566952:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788526732.567083:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.567096:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788526732.567100:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526732.567107:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.567156:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.567173:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 12 pid: 6669 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.567186:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881561856:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526732.567274:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fe40 going to sleep for 11 seconds 00000004:00080000:3.0:1788526732.567325:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c2746c1c00/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788526732.567332:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881561728:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788526732.569090:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788526732.569119:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788526732.569158:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c242d4f9c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788526732.569164:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274628f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c242d4f3c0 00000020:00080000:0.0:1788526732.569169:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c274628b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c274685c00 00000004:00080000:0.0:1788526732.569217:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788526732.569239:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c27b77e900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788526732.569241:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c24933ae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c27b77e0c0 00000020:00080000:0.0:1788526732.569244:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c24933a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c27f75b000 00000004:00080000:0.0:1788526732.569270:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788526732.569536:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788526732.569797:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788526732.570095:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881561984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788526732.570187:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526732.570286:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881561984 00000100:00100000:3.0:1788526732.570297:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881561984 00000100:00100000:3.0:1788526732.570357:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788526732.570368:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875405881561984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788526732.570442:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788526732.570490:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ac08a, atime: 0x6a9ac08a, ctime: 0x6a9ac08a, blocks: 0x1 00010000:00010000:3.0:1788526732.570501:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.570523:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788526732.570529:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526732.570538:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.570584:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.570597:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.570606:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.570634:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526732.572726:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526732.572743:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.572771:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526732.572779:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.572792:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.572817:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.572826:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c69a34/0x367645d450b3b150 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.572854:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526732.572857:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526732.572879:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526732.573019:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:11605:x1875405868989184:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 69833us (79465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.573030:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:3.0:1788526732.575051:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875405881561984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4670us (4849us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788526732.575068:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788526732.575523:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.576044:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989312 00000100:00100000:1.0:1788526732.576058:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989312 00010000:00010000:1.0:1788526732.576111:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 13 pid: 6669 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.576163:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:1.0:1788526732.576174:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:2348:x1875405868989312:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526732.576198:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526732.576205:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 13 pid: 6669 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.576221:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 13 pid: 6669 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.576252:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526732.576259:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526732.576266:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.576278:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.576325:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526732.576565:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+13:2348:x1875405868989312:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 391us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526732.576574:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00010000:00010000:3.0:1788526732.577635:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a5b4d75/0x367645d450b3af0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc596bb expref: 12 pid: 6669 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.577661:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881561856:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526732.577691:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.577704:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.577712:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.577739:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.577759:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.577778:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788526732.578572:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3280:x1875405881561600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12261us (12788us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788526732.578583:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1788526732.578655:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c2746c0000/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788526732.578662:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881561600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788526732.579146:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1788526732.579234:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526732.579245:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.579258:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526732.579263:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.579277:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.579302:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.579310:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce3d2176/0x367645d450b3b149 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.579338:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526732.579340:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526732.579341:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526732.579581:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989440 00000100:00100000:3.0:1788526732.579590:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989440 00000100:00100000:3.0:1788526732.579689:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1788526732.579700:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+12:2348:x1875405868989440:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788526732.580190:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c2746c1f80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788526732.580202:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881561984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788526732.622221:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+12:2348:x1875405868989440:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 42503us (43059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526732.622262:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000001:00080000:1.0:1788526732.622314:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:1.0:1788526732.622325:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788526732.622343:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788526732.622349:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1788526732.625583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.625856:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989696 00000100:00100000:3.0:1788526732.625877:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989696 00000100:00100000:3.0:1788526732.625955:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:3.0:1788526732.625968:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+20:11605:x1875405868989696:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.626059:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526732.626101:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5974e expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.626151:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526732.626158:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526732.626205:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.626226:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.626240:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526732.626682:0:6721:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb45af14 reply state 000000008d5399f9 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.626694:0:6721:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788526732.626846:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+21:11605:x1875405868989696:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 879us (1276us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788526732.626855:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:3.0:1788526732.630937:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526732.631133:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868989824 00000100:00100000:0.0:1788526732.631147:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868989824 00000100:00100000:0.0:1788526732.631223:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:0.0:1788526732.631236:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868989824:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788526732.631639:0:12011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788526732.631644:0:12011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788526731 -> 1788526730 00002000:00010000:0.0:1788526732.631646:0:12011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788526730 00002000:00010000:0.0:1788526732.631649:0:12011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788526731 -> 1788526730 00002000:00010000:0.0:1788526732.631651:0:12011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788526732.631735:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868989824:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 499us (816us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788526732.631745:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00010000:00010000:1.0:1788526732.631950:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.631963:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.631972:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.631979:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.631984:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.631994:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.632016:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:1.0:1788526732.632020:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526732.632027:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.632034:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7000/0x367645d450b3b157 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.634605:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.635024:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990080 00000100:00100000:1.0:1788526732.635065:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990080 00000100:00100000:1.0:1788526732.635178:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:1.0:1788526732.635189:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+20:11605:x1875405868990080:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788526732.635290:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.635314:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.635325:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.635373:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.635599:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 20 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.635620:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881562112:192.168.204.59@tcp:104: 00000100:00100000:0.0:1788526732.636072:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526732.639443:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.639558:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b577480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875405881562112:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526732.639597:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.640552:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990208 00000100:00100000:3.0:1788526732.640567:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990208 00010000:00010000:3.0:1788526732.640628:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 21 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.640712:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:3.0:1788526732.640724:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:2348:x1875405868990208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526732.640774:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526732.640783:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 21 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640798:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 21 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640828:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c77600/0x367645d450b3b118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59740 expref: 21 pid: 5823 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640850:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526732.640856:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640877:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640888:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.640927:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526732.641003:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:2348:x1875405868990208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 281us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.641011:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00010000:00010000:0.0:1788526732.641547:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641557:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641594:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641601:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641608:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641615:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526732.641621:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641630:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641655:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:0.0:1788526732.641658:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788526732.641662:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.641669:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110000/0x367645d450b3b15e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526732.641737:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:11605:x1875405868990080:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 6549us (7150us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788526732.641745:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:1.0:1788526732.645835:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.646054:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990336 00000100:00100000:3.0:1788526732.646071:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990336 00000100:00100000:3.0:1788526732.646194:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:3.0:1788526732.646207:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868990336:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788526732.646292:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.646318:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.646328:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526732.646333:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788526732.646338:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.646525:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.646545:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 8 pid: 6671 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.646565:0:6669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881562240:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526732.646693:0:6669:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242d4fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526732.649550:0:6669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c14211d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6669:1875405881562240:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526732.649595:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.651565:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.651865:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990464 00000100:00100000:2.0:1788526732.651878:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990464 00010000:00010000:2.0:1788526732.651939:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 9 pid: 6671 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526732.651994:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:2.0:1788526732.652005:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+9:2348:x1875405868990464:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526732.652023:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526732.652064:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 9 pid: 6671 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.652082:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 9 pid: 6671 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.652115:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b142 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5975c expref: 9 pid: 6671 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.652138:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788526732.652144:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788526732.652152:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.652190:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.652229:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526732.652571:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+8:2348:x1875405868990464:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 565us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.652579:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00010000:00010000:3.0:1788526732.652843:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652855:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652889:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652913:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652922:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652930:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526732.652936:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652946:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652962:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.652985:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c922f6e3/0x367645d450b3b165 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.653054:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868990336:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 6850us (7234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.653063:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:3.0:1788526732.656232:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.656784:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990720 00000100:00100000:2.0:1788526732.656799:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990720 00000100:00100000:1.0:1788526732.657182:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:1.0:1788526732.657201:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+19:11605:x1875405868990720:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788526732.657314:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.657339:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.657354:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.657972:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.657992:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.658001:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.658046:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.658063:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 20 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.658080:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b574a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881562368:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526732.658258:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.661614:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526732.661717:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990848 00000100:00100000:1.0:1788526732.661730:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990848 00010000:00010000:1.0:1788526732.661793:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 21 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.661847:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1788526732.661858:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:2349:x1875405868990848:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526732.661882:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526732.661891:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 21 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.661907:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 21 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.661940:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:1.0:1788526732.661946:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.661958:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.661967:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.661992:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526732.662061:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:2349:x1875405868990848:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 204us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526732.662069:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00010000:00010000:1.0:1788526732.662710:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7800/0x367645d450b3b126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59747 expref: 20 pid: 5822 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526732.662730:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b574a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881562368:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526732.662744:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.662769:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.662775:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526732.663044:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788526732.663532:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788526732.663583:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788526732.663805:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881562496:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788526732.663893:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526732.663932:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.664156:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881562496 00000100:00100000:0.0:1788526732.664164:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881562496 00000100:00100000:0.0:1788526732.664221:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788526732.664230:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881562496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788526732.664337:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881562496:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526732.664344:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526732.664514:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788526732.664521:0:5824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788526732.664565:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c2746c1c00, transno 4294967321 00000004:00080000:3.0:1788526732.664572:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c2746c0000, transno 4294967322 00000100:00100000:3.0:1788526732.664580:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881562496:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788526732.665364:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788526732.665588:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881562624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788526732.665736:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526732.665774:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242a98d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.665848:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881562624 00000100:00100000:0.0:1788526732.665856:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881562624 00000100:00100000:0.0:1788526732.666002:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788526732.666012:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1875405881562624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788526732.666241:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875405881562624:12345-0@lo:1000:mdt00_002.0 Request processed in 230us (504us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788526732.666250:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788526732.666326:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875405881562624:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788526732.666374:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666417:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666428:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666436:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526732.666443:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666453:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666472:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c260d60b00) 00010000:00010000:3.0:1788526732.666475:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526732.666481:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666488:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110200/0x367645d450b3b173 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666539:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666545:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666552:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666557:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526732.666561:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666566:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666575:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526732.666578:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526732.666586:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666600:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666759:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.666799:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 23 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.666824:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1422c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881562752:192.168.204.59@tcp:105: 00000100:00100000:3.0:1788526732.666926:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2581729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526732.671703:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.671756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868990976 00000100:00100000:3.0:1788526732.671765:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868990976 00000100:00100000:1.0:1788526732.671779:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1422c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875405881562752:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526732.671817:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671830:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b0b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671872:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671891:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671926:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671939:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671946:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671953:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671960:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.671965:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.671974:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.671988:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00010000:00010000:1.0:1788526732.671989:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526732.671992:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526732.671997:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.672001:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+24:11604:x1875405868990976:12345-192.168.204.59@tcp:49:lfs.0 00010000:00010000:1.0:1788526732.672003:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b17a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672012:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672018:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672028:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672034:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526732.672036:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672042:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672049:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526732.672052:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788526732.672055:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526732.672060:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110a00/0x367645d450b3b16c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.672175:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+24:11604:x1875405868990976:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 177us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526732.672183:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000040:00080000:1.0:1788526732.672453:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526732.672458:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526732.673560:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788526732.673573:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788526732.674551:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c14211d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+23:11605:x1875405868990720:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 17342us (18320us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788526732.674595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 230 00000020:00080000:0.0:1788526732.674605:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788526732.677530:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.677738:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868991232 00000100:00100000:2.0:1788526732.677763:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868991232 00000100:00100000:2.0:1788526732.677855:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:2.0:1788526732.677868:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:11604:x1875405868991232:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:2.0:1788526732.678467:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788526732.678588:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:11604:x1875405868991232:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 721us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.678598:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:3.0:1788526732.679199:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526732.679727:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868991488 00000100:00100000:0.0:1788526732.679738:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868991488 00000100:00100000:0.0:1788526732.679811:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:0.0:1788526732.679821:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+23:11605:x1875405868991488:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788526732.681213:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788526732.681334:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788526732.681436:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681458:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681473:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681482:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681490:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681497:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.681527:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526732.681648:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526732.681657:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.681665:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526732.681670:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.681680:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.681696:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98c243972c00) 00010000:00010000:3.0:1788526732.681699:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788526732.681705:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.681726:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b181 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.681758:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526732.681760:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526732.681762:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526732.682821:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+25:11605:x1875405868991488:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2987us (3609us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788526732.682853:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000020:00080000:0.0:1788526732.682862:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788526732.713911:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.713987:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868991616 00000100:00100000:3.0:1788526732.714002:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868991616 00000100:00100000:3.0:1788526732.714202:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:3.0:1788526732.714216:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+25:11607:x1875405868991616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526732.714248:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526732.714275:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59763 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714363:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714380:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714500:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714518:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714526:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.714533:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.715134:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.715151:0:6721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.715160:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.715206:0:6721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526732.715230:0:6721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 26 pid: 5824 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526732.715246:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881562880:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526732.715535:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2581729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526732.718149:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6721:1875405881562880:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526732.718189:0:6721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526732.720816:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526732.721316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868991872 00000100:00100000:3.0:1788526732.721331:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868991872 00000100:00100000:3.0:1788526732.721440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1788526732.721452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+27:5589:x1875405868991872:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788526732.721776:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+28:5589:x1875405868991872:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 326us (975us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788526732.721785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1788526732.724135:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526732.724447:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868992000 00000100:00100000:2.0:1788526732.724460:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868992000 00010000:00010000:2.0:1788526732.724514:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 28 pid: 5824 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526732.724563:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:2.0:1788526732.724573:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+28:2348:x1875405868992000:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526732.724594:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526732.724619:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 28 pid: 5824 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724634:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 28 pid: 5824 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724664:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b0a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59724 expref: 28 pid: 5824 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724687:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526732.724695:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724706:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724717:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526732.724766:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526732.725003:0:6721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725013:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526732.725079:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788526732.725084:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526732.725112:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725129:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725142:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725149:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725156:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725174:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526732.725179:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725188:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725199:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:0.0:1788526732.725202:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526732.725205:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725211:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b18f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725224:0:6721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725229:0:6721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725235:0:6721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725239:0:6721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526732.725241:0:6721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725246:0:6721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725264:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98c242a8bf00) 00010000:00010000:0.0:1788526732.725267:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526732.725270:0:6721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725275:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725316:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59763 expref: 28 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725329:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59763 expref: 27 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526732.725336:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:0.0:1788526732.725338:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526732.725340:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6c00, rc 0) 00000100:00100000:0.0:1788526732.725456:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+27:11607:x1875405868991616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 11243us (11563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526732.725465:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:2.0:1788526732.725605:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f122900d-e71c-4fc3-b559-b19040da7c34+26:2348:x1875405868992000:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1032us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526732.725615:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000001:00080000:2.0:1788526733.405561:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788526733.405588:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788526733.405594:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788526733.523869:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526733.715698:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788526733.715713:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788526733.715775:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788526733.715784:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788526733.715977:0:11672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b576680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881563008:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788526733.716115:0:11672:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526733.736955:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526733.737097:0:11672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b576680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11672:1875405881563008:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788526733.737367:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868992128 00000100:00100000:2.0:1788526733.737381:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868992128 00000100:00100000:2.0:1788526733.737502:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:2.0:1788526733.737514:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+26:11618:x1875405868992128:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788526733.737581:0:5822:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788526733.737725:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+26:11618:x1875405868992128:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 213us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526733.737744:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:2.0:1788526733.748858:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526733.749423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868992384 00000100:00100000:3.0:1788526733.749475:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868992384 00000100:00100000:3.0:1788526733.749575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1788526733.749588:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+26:11618:x1875405868992384:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526733.749620:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526733.749654:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b1a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5976a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.749814:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b1ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.749833:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.749861:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b1ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526733.750049:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788526733.750235:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7e00/0x367645d450b3b1a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5976a expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.750262:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b1ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5976a expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.750274:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526733.750277:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788526733.750282:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7200, rc 0) 00000100:00100000:3.0:1788526733.750647:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+28:11618:x1875405868992384:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1058us (1802us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788526733.750656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:0.0:1788526733.764484:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526733.764656:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868992640 00000100:00100000:3.0:1788526733.764672:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868992640 00000100:00100000:3.0:1788526733.764769:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 235 00000100:00100000:3.0:1788526733.764782:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+28:11618:x1875405868992640:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788526733.764915:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.764941:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.764957:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765231:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765241:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765249:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765255:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526733.765261:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765271:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765287:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526733.765290:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788526733.765305:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.765313:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7a00/0x367645d450b3b1b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526733.765888:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+29:11618:x1875405868992640:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 1103us (1416us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788526733.765900:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 235 00000040:00080000:3.0:1788526733.766072:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788526733.766079:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788526733.767167:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788526733.767186:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788526733.771212:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526733.771265:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526733.771658:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868992896 00000100:00100000:3.0:1788526733.771672:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868992896 00000100:00100000:3.0:1788526733.771758:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1788526733.771773:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+29:11618:x1875405868992896:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788526733.772163:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+30:11618:x1875405868992896:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 392us (965us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788526733.772175:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1788526733.773282:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993024 00000100:00100000:3.0:1788526733.773298:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993024 00000100:00100000:3.0:1788526733.773624:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1788526733.773638:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+30:2349:x1875405868993024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526733.773658:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526733.773695:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7200/0x367645d450b3b1ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5976a expref: 30 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526733.773742:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:3.0:1788526733.773749:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526733.773824:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f122900d-e71c-4fc3-b559-b19040da7c34+29:2349:x1875405868993024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 189us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526733.773832:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000040:00080000:3.0:1788526733.880120:0:12510:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788526733.880134:0:12510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788526733.880186:0:12510:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788526733.880193:0:12510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788526734.098560:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526734.098606:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993280 00000100:00100000:2.0:1788526734.098621:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993280 00000100:00100000:2.0:1788526734.098713:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00080000:1.0:1788526734.098734:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526734.098736:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+29:11631:x1875405868993280:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526734.098776:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526734.098807:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3b1c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59771 expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526734.099133:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3b1c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526734.099154:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3b1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526734.099168:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3b1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526734.099183:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788526734.099349:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76400/0x367645d450b3b1c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59771 expref: 32 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526734.099372:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3b1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59771 expref: 31 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526734.099432:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:2.0:1788526734.099436:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788526734.099441:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76000, rc 0) 00000100:00100000:2.0:1788526734.101443:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f122900d-e71c-4fc3-b559-b19040da7c34+31:11631:x1875405868993280:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2699us (2878us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788526734.101460:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:0.0:1788526734.111666:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526734.111712:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993408 00000100:00100000:0.0:1788526734.111737:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993408 00000100:00100000:0.0:1788526734.111825:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:0.0:1788526734.111837:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:11631:x1875405868993408:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1788526734.111941:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.111963:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.111978:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113879:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113902:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113911:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113919:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526734.113926:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113936:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113957:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:0.0:1788526734.113961:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788526734.113966:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526734.113989:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b1d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526734.114132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:11631:x1875405868993408:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 2292us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526734.114144:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:0.0:1788526734.210880:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526734.211010:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993536 00000100:00100000:1.0:1788526734.211026:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993536 00000100:00100000:1.0:1788526734.211142:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:1.0:1788526734.211156:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2349:x1875405868993536:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1788526734.211182:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526734.211213:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef235592/0x367645d450b3b1dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59778 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788526734.211251:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ac08a, atime: 0x6a9ac08a, ctime: 0x6a9ac08a, blocks: 0xb 00010000:00010000:1.0:1788526734.211282:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1788526734.211288:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526734.211300:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef235592/0x367645d450b3b1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59778 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526734.211326:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef235592/0x367645d450b3b1dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59778 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526734.211344:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111200, rc 0) 00000100:00100000:1.0:1788526734.211505:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+8:2349:x1875405868993536:12345-192.168.204.59@tcp:101:cat.0 Request processed in 351us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526734.211517:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00080000:0.0:1788526734.212076:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526734.220350:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526734.220657:0:12064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993664 00000100:00100000:1.0:1788526734.220674:0:12064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993664 00002000:00100000:1.0:1788526734.220756:0:12064:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98c274725500 x1875405868993664/t0(0) o3->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:450/0 lens 488/0 e 0 to 0 dl 1788526745 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788526734.220796:0:12064:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274725500 with x1875405868993664 ext(0->4095) 00002000:00010000:1.0:1788526734.220804:0:12064:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c274725500 00000100:00100000:1.0:1788526734.220852:0:12064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526734.220863:0:12064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f122900d-e71c-4fc3-b559-b19040da7c34+8:2350:x1875405868993664:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:1.0:1788526734.221325:0:12064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f122900d-e71c-4fc3-b559-b19040da7c34+8:2350:x1875405868993664:12345-192.168.204.59@tcp:3:cat.0 Request processed in 461us (992us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788526734.221335:0:12064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00002000:00100000:1.0:1788526734.221343:0:12064:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98c274725500 x1875405868993664/t0(0) o3->f122900d-e71c-4fc3-b559-b19040da7c34@192.168.204.59@tcp:450/0 lens 488/4536 e 0 to 0 dl 1788526745 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788526734.221353:0:12064:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98c274725500 with x1875405868993664 ext(0->4095) 00002000:00010000:1.0:1788526734.221357:0:12064:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98c274725500 00010000:00010000:2.0:1788526734.549836:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526734.803811:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881563392:0@lo:400:kworker.0 00000100:00100000:1.0:1788526734.803820:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881563264:0@lo:400:kworker.0 00000100:00100000:0.0:1788526734.803915:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526734.803983:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526734.803985:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881563904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526734.804008:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ea49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881563776:0@lo:400:kworker.0 00000100:00100000:2.0:1788526734.804090:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881563520:0@lo:400:kworker.0 00000100:00100000:3.0:1788526734.804172:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881563136:0@lo:400:kworker.0 00000100:00100000:1.0:1788526734.808208:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526734.808418:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526734.808662:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563904 00000100:00100000:0.0:1788526734.808675:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563904 00000100:00100000:2.0:1788526734.809843:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563392 00000100:00100000:2.0:1788526734.809857:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563392 00000100:00100000:1.0:1788526734.810697:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563264 00000100:00100000:1.0:1788526734.810719:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563264 00000100:00100000:1.0:1788526734.810990:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788526734.811004:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881563264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526734.811099:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881563264:12345-0@lo:400:kworker.0 Request processed in 98us (7115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526734.811108:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788526734.811148:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526734.811269:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881563264:0@lo:400:kworker.0 00000100:00100000:2.0:1788526734.816268:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788526734.816290:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881563392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526734.816443:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881563392:12345-0@lo:400:kworker.0 Request processed in 159us (12528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526734.816451:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788526734.816493:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563776 00000100:00100000:2.0:1788526734.816502:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563776 00000100:00100000:2.0:1788526734.816532:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563520 00000100:00100000:2.0:1788526734.816535:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563520 00000100:00100000:2.0:1788526734.816703:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788526734.816721:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881563776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526734.816777:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1422c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881563776:12345-0@lo:400:kworker.0 Request processed in 58us (8584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526734.816784:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788526734.816815:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788526734.816822:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881563520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526734.816866:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881563520:12345-0@lo:400:kworker.0 Request processed in 44us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526734.816873:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788526734.816931:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788526734.816940:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788526734.816969:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c2746c1f80, transno 4294967310 00000100:00100000:2.0:1788526734.816989:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881563520:0@lo:400:kworker.0 00000100:00100000:0.0:1788526734.817340:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788526734.817432:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881563904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526734.817471:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526734.817523:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881563904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (9106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526734.817530:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788526734.817575:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881563392:0@lo:400:kworker.0 00000100:00100000:0.0:1788526734.817598:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881563904:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788526734.817601:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788526734.817607:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788526734.817653:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000100:00100000:0.0:1788526734.817654:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ea49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881563776:0@lo:400:kworker.0 00000040:00080000:3.0:1788526734.817660:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788526734.817752:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788526734.817764:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526734.817773:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526734.817776:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526734.817798:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881563648:0@lo:400:kworker.0 00000100:00100000:3.0:1788526734.817834:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526734.817921:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563648 00000100:00100000:1.0:1788526734.817927:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563648 00000100:00100000:1.0:1788526734.817986:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788526734.817993:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526734.818039:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881563648:12345-0@lo:400:kworker.0 Request processed in 47us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526734.818046:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788526734.818052:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c144019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881563648:0@lo:400:kworker.0 00000100:00080000:1.0:1788526734.818068:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526734.819961:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881563136 00000100:00100000:0.0:1788526734.820010:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881563136 00000100:00100000:0.0:1788526734.820096:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788526734.820107:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526734.820245:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881563136:12345-0@lo:400:kworker.0 Request processed in 141us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526734.820253:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788526734.820659:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881563136:0@lo:400:kworker.0 00010000:00010000:1.0:1788526735.571589:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526735.831860:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c1432a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881564032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526735.831938:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526735.832110:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564032 00000100:00100000:0.0:1788526735.832118:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564032 00000100:00100000:0.0:1788526735.832172:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788526735.832180:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881564032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526735.832216:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526735.832258:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881564032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526735.832265:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788526735.832343:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c1432a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881564032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526736.023903:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526736.023955:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526736.023986:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526736.024009:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526736.024054:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526736.024084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994304 00000100:00100000:0.0:1788526736.024094:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994304 00000100:00100000:0.0:1788526736.024152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993920 00000100:00100000:0.0:1788526736.024155:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993920 00000100:00100000:0.0:1788526736.024177:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:0.0:1788526736.024186:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868994304:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526736.024281:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2351:x1875405868994304:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526736.024304:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:0.0:1788526736.024325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:0.0:1788526736.024333:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:2351:x1875405868993920:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526736.024365:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f122900d-e71c-4fc3-b559-b19040da7c34+31:2351:x1875405868993920:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526736.024371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:2.0:1788526736.024751:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994048 00000100:00100000:2.0:1788526736.024757:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994048 00000100:00100000:2.0:1788526736.024861:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994176 00000100:00100000:2.0:1788526736.024865:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994176 00000100:00100000:2.0:1788526736.024894:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:2.0:1788526736.024902:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868994048:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526736.024933:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c1432a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+5:2351:x1875405868994048:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526736.024939:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:2.0:1788526736.024952:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1788526736.024958:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+8:2351:x1875405868994176:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526736.024983:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f122900d-e71c-4fc3-b559-b19040da7c34+8:2351:x1875405868994176:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526736.024990:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:1.0:1788526736.025585:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868993792 00000100:00100000:1.0:1788526736.025591:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868993792 00000100:00100000:1.0:1788526736.025703:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 326 00000100:00100000:1.0:1788526736.025713:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868993792:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526736.025746:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868993792:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526736.025752:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 326 00000100:00080000:1.0:1788526736.025942:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526736.025947:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526736.025962:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788526736.597458:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526737.623415:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526737.945861:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788526737.945879:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788526737.994894:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:3.0:1788526737.994927:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788526737.994950:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788526737.994974:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98c242d4fcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788526737.994980:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c24933a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98c242d4f3c0 00000020:00080000:3.0:1788526737.994984:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98c24933a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98c27b704800 00000020:00080000:0.0:1788526737.995217:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788526738.004064:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788526738.643866:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526739.679501:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526739.923912:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881564160:0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.924012:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526739.924073:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881564672:0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.924105:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526739.924138:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526739.924158:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881564544:0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.924184:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526739.924221:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564160 00000100:00100000:3.0:1788526739.924230:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564160 00000100:00100000:3.0:1788526739.924277:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788526739.924288:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881564160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.924340:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3279:x1875405881564160:12345-0@lo:400:kworker.0 Request processed in 53us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526739.924347:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788526739.924383:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564672 00000100:00100000:3.0:1788526739.924409:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564672 00000100:00100000:3.0:1788526739.924447:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788526739.924453:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881564672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.924897:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881564672:12345-0@lo:400:kworker.0 Request processed in 443us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526739.924904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788526739.924929:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564544 00000100:00100000:3.0:1788526739.924933:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564544 00000100:00100000:3.0:1788526739.924967:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788526739.924974:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881564544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.925008:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881564544:12345-0@lo:400:kworker.0 Request processed in 35us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526739.925028:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788526739.925075:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881564544:0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.925086:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881564160:0@lo:400:kworker.0 00000100:00100000:3.0:1788526739.925095:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881564672:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925266:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881564288:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925311:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526739.925337:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881564800:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925361:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526739.925380:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788526739.925405:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881564416:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925429:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526739.925460:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564288 00000100:00100000:0.0:1788526739.925464:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564288 00000100:00100000:0.0:1788526739.925498:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564416 00000100:00100000:0.0:1788526739.925501:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564416 00000100:00100000:0.0:1788526739.925522:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788526739.925529:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881564288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925565:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881564288:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526739.925571:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788526739.925583:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788526739.925597:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881564416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925638:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881564416:12345-0@lo:400:kworker.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526739.925644:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788526739.925663:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564800 00000100:00100000:0.0:1788526739.925666:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564800 00000100:00100000:0.0:1788526739.925691:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788526739.925697:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881564800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925727:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881564800:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526739.925733:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788526739.925762:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881564416:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925771:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881564288:0@lo:400:kworker.0 00000100:00100000:0.0:1788526739.925779:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788526739.925784:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788526739.925801:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881564800:0@lo:400:kworker.0 00000100:00080000:1.0:1788526739.926018:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526739.926023:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788526739.926026:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526739.926031:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526739.926039:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27f68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881564928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526739.926071:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526739.926103:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881564928 00000100:00100000:1.0:1788526739.926107:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881564928 00000100:00100000:1.0:1788526739.926135:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788526739.926142:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881564928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526739.926184:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526739.926220:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881564928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526739.926226:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788526739.926260:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27f68ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881564928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526740.066037:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526740.066205:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994432 00000100:00100000:2.0:1788526740.066229:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994432 00000100:00100000:2.0:1788526740.066315:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:2.0:1788526740.066326:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:11284:x1875405868994432:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788526740.066643:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:11284:x1875405868994432:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 318us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526740.066651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00080000:1.0:1788526740.067253:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526740.073700:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526740.074329:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994688 00000100:00100000:3.0:1788526740.074342:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994688 00000100:00100000:3.0:1788526740.074433:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:3.0:1788526740.074444:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:11284:x1875405868994688:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788526740.074890:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+19:11284:x1875405868994688:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 446us (1199us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788526740.074898:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:3.0:1788526740.364829:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526740.365023:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994816 00000100:00100000:0.0:1788526740.365032:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994816 00000100:00100000:0.0:1788526740.365204:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:0.0:1788526740.365214:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:12082:x1875405868994816:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:0.0:1788526740.365236:0:6721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526740.365257:0:6721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3b1e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5977f expref: -99 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788526740.365267:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788526740.365345:0:6721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526740.365360:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526740.365371:0:6721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526740.365437:0:6721:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526740.365441:0:6721:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526740.365461:0:6721:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6721 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526740.365759:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821600/0x367645d450b3b1e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5977f expref: 7 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526740.365778:0:6721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5977f expref: 6 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526740.365787:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526740.365789:0:6721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526740.365794:0:6721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820200, rc 0) 00000100:00100000:0.0:1788526740.365872:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:12082:x1875405868994816:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 659us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526740.365881:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 239 00010000:00010000:1.0:1788526740.693985:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526740.947921:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526740.948010:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526740.948116:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565056 00000100:00100000:1.0:1788526740.948124:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565056 00000100:00100000:1.0:1788526740.948182:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788526740.948191:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881565056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526740.948226:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526740.955854:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881565056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7650us (7830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526740.955889:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788526740.959968:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26eb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526741.144083:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526741.144127:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526741.144164:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526741.144192:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526741.144211:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526741.144989:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995456 00000100:00100000:3.0:1788526741.145010:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995456 00000100:00100000:3.0:1788526741.145073:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995072 00000100:00100000:3.0:1788526741.145077:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995072 00000100:00100000:3.0:1788526741.145100:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:3.0:1788526741.145109:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2348:x1875405868995456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526741.145188:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2348:x1875405868995456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526741.145211:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:3.0:1788526741.145243:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1788526741.145250:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+19:2348:x1875405868995072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526741.145279:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f122900d-e71c-4fc3-b559-b19040da7c34+19:2348:x1875405868995072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526741.145286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1788526741.145316:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995200 00000100:00100000:3.0:1788526741.145320:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995200 00000100:00100000:2.0:1788526741.145352:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995328 00000100:00100000:2.0:1788526741.145358:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995328 00000100:00100000:3.0:1788526741.145376:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:3.0:1788526741.145416:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868995200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526741.145426:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:2.0:1788526741.145454:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868995328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526741.145492:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2348:x1875405868995328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 58us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526741.145509:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00080000:2.0:1788526741.145551:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526741.145556:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526741.146119:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868994944 00000100:00100000:0.0:1788526741.146127:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868994944 00000100:00100000:0.0:1788526741.146191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 328 00000100:00100000:0.0:1788526741.146200:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868994944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526741.146253:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e25535f2-071e-428f-98ae-fe60202a1364+14:2348:x1875405868994944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 56us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526741.146259:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 328 00000100:00100000:3.0:1788526741.147161:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f68ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2348:x1875405868995200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1773us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526741.147172:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00010000:00010000:1.0:1788526741.715682:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526742.739745:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788526743.040515:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788526743.040554:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788526743.040605:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788526743.040616:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788526743.764094:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788526744.022888:0:11672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788526744.022900:0:11672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788526744.023543:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788526744.023554:0:11672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1788526744.145268:0:12710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:59:01 (1788526741) 00010000:00010000:1.0:1788526744.787592:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526745.045384:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881565184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526745.045482:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526745.045579:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565184 00000100:00100000:1.0:1788526745.045588:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565184 00000100:00100000:1.0:1788526745.045650:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788526745.045660:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881565184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526745.045695:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526745.045740:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881565184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526745.045748:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788526745.045768:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526745.045807:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881565184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526745.050555:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881565312:0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.050630:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526745.050670:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.050703:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526745.050731:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526745.050737:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881565440:0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.050775:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526745.050811:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565312 00000100:00100000:3.0:1788526745.050819:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565312 00000100:00100000:3.0:1788526745.050867:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788526745.050876:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.050926:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3280:x1875405881565312:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526745.050934:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788526745.050970:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565824 00000100:00100000:3.0:1788526745.050974:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565824 00000100:00100000:3.0:1788526745.051010:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565440 00000100:00100000:3.0:1788526745.051014:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565440 00000100:00100000:3.0:1788526745.051035:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788526745.051042:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.051079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881565824:12345-0@lo:400:kworker.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526745.051086:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788526745.051099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788526745.051106:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881565440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526745.051136:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881565440:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526745.051343:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2742f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881565440:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051353:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881565312:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051362:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881565824:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051422:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881565568:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051455:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526745.051486:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526745.051492:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881565696:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051531:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526745.051560:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565696 00000100:00100000:2.0:1788526745.051564:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565696 00000100:00100000:2.0:1788526745.051596:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788526745.051602:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881565696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051637:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881565696:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526745.051643:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788526745.051663:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565568 00000100:00100000:2.0:1788526745.051667:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565568 00000100:00100000:2.0:1788526745.051684:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788526745.051690:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881565568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051720:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881565568:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526745.051725:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788526745.051748:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881565696:0@lo:400:kworker.0 00000100:00100000:2.0:1788526745.051756:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881565568:0@lo:400:kworker.0 00000100:00080000:2.0:1788526745.051791:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526745.051796:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526745.052549:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:1.0:1788526745.811829:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526746.069239:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526746.069265:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881565952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526746.069340:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526746.069407:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881565952 00000100:00100000:1.0:1788526746.069418:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881565952 00000100:00100000:1.0:1788526746.069635:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788526746.069645:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881565952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788526746.069682:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526746.069740:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881565952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526746.069746:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788526746.070225:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881565952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526746.264330:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526746.264413:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526746.264442:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995712 00000100:00100000:0.0:1788526746.264449:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995584 00000100:00100000:2.0:1788526746.264451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995712 00000100:00100000:0.0:1788526746.264452:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995584 00000100:00100000:2.0:1788526746.264509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:0.0:1788526746.264509:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 330 00000100:00100000:0.0:1788526746.264519:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868995584:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526746.264520:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:2350:x1875405868995712:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526746.264585:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+18:2350:x1875405868995712:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 68us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526746.264602:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00080000:2.0:1788526746.264625:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526746.266970:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+14:2350:x1875405868995584:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 2439us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526746.266984:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 330 00000100:00100000:0.0:1788526746.275816:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526746.275863:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526746.275909:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995840 00000100:00100000:1.0:1788526746.275920:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995840 00000100:00100000:0.0:1788526746.275951:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526746.275975:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868996096 00000100:00100000:1.0:1788526746.275977:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868995968 00000100:00100000:1.0:1788526746.275979:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868995968 00000100:00100000:0.0:1788526746.275979:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868996096 00000100:00100000:1.0:1788526746.276014:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:0.0:1788526746.276014:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:1.0:1788526746.276024:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868995840:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526746.276024:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2350:x1875405868996096:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526746.276094:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+5:2350:x1875405868995840:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526746.276101:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:1.0:1788526746.276119:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:1.0:1788526746.276124:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:2351:x1875405868995968:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526746.281858:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c141d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2350:x1875405868996096:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 5822us (5893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526746.281875:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:1.0:1788526746.284748:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f122900d-e71c-4fc3-b559-b19040da7c34+7:2351:x1875405868995968:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8610us (8872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526746.284763:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00080000:1.0:1788526746.284816:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526746.284822:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526746.284825:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788526746.835848:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526747.860295:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526748.531228:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526748.531451:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868996352 00000100:00100000:0.0:1788526748.531462:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868996352 00000100:00100000:0.0:1788526748.531546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1788526748.531560:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+18:12303:x1875405868996352:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1788526748.531960:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:12303:x1875405868996352:12345-192.168.204.59@tcp:35:umount.0 Request processed in 403us (741us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788526748.531967:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00080000:1.0:1788526748.532626:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526748.536967:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526748.537212:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868996608 00000100:00100000:0.0:1788526748.537223:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868996608 00000100:00100000:0.0:1788526748.537286:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1788526748.537296:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+19:12303:x1875405868996608:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1788526748.537845:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:12303:x1875405868996608:12345-192.168.204.59@tcp:35:umount.0 Request processed in 548us (884us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788526748.537852:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1788526748.543280:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526748.543433:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868996864 00000100:00100000:0.0:1788526748.543457:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868996864 00000100:00100000:0.0:1788526748.543576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:0.0:1788526748.543588:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2566b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+20:12303:x1875405868996864:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1788526748.543866:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2566b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f122900d-e71c-4fc3-b559-b19040da7c34+21:12303:x1875405868996864:12345-192.168.204.59@tcp:35:umount.0 Request processed in 281us (595us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788526748.543875:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1788526748.549452:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526748.549994:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868997120 00000100:00100000:3.0:1788526748.550006:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868997120 00000100:00100000:3.0:1788526748.550053:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1788526748.550063:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+21:12303:x1875405868997120:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:3.0:1788526748.550496:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:12303:x1875405868997120:12345-192.168.204.59@tcp:35:umount.0 Request processed in 432us (1061us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788526748.550505:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:1.0:1788526748.562481:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526748.562513:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526748.562566:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526748.562735:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868997248 00000100:00100000:0.0:1788526748.562747:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868997248 00000100:00100000:0.0:1788526748.562800:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868997504 00000100:00100000:0.0:1788526748.562803:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868997504 00000100:00100000:0.0:1788526748.562818:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868997376 00000100:00100000:0.0:1788526748.562821:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868997376 00000100:00100000:0.0:1788526748.562852:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526748.562864:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+16:2351:x1875405868997248:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526748.562888:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526748.562911:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030000/0x367645d450b3a1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59303 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526748.562929:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526748.562993:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+15:2351:x1875405868997248:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 132us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526748.563001:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526748.563018:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526748.563026:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+14:2351:x1875405868997504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526748.563034:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526748.563044:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241663400/0x367645d450b3a476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593d5 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526748.563053:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526748.563072:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+13:2351:x1875405868997504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 48us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526748.563092:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526748.563106:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1788526748.563113:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+12:2351:x1875405868997376:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526748.563121:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526748.563130:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c28216d200/0x367645d450b3a1a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc592cb expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526748.563140:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526748.563157:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+11:2351:x1875405868997376:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 45us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526748.563172:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1788526748.569216:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526748.570009:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868997632 00000100:00100000:1.0:1788526748.570032:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868997632 00000100:00100000:1.0:1788526748.570119:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1788526748.570129:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+11:2349:x1875405868997632:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526748.570146:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526748.570167:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55400/0x367645d450b3a21c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5930a expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.570186:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526748.570255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e25535f2-071e-428f-98ae-fe60202a1364+10:2349:x1875405868997632:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 127us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526748.570263:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1788526748.570576:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526748.570637:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868998016 00000100:00100000:3.0:1788526748.570652:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868998016 00000100:00100000:3.0:1788526748.570745:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1788526748.570757:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+7:2347:x1875405868998016:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:3.0:1788526748.570794:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a79b 00000020:00010000:3.0:1788526748.570804:0:6670:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c274ba5000: total 0 00000100:00080000:3.0:1788526748.570810:0:6670:0:(import.c:65:import_set_state_nolock()) ffff98c242c2e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526748.570871:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1788526748.571435:0:5811:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c274ba5000: total 0 00010000:00010000:0.0:1788526748.571510:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c274ba5000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788526748.571573:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3ab3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595aa expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526748.571610:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef235592/0x367645d450b3b1dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59778 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526748.571649:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c274ba5000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788526748.571685:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526748.571688:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526748.571691:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526748.571779:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f122900d-e71c-4fc3-b559-b19040da7c34+2:2347:x1875405868998016:12345-192.168.204.59@tcp:9:umount.0 Request processed in 1019us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526748.571790:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00080000:1.0:1788526748.572980:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526748.579107:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526748.579246:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868998144 00000100:00100000:3.0:1788526748.579261:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868998144 00000100:00100000:3.0:1788526748.579372:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:3.0:1788526748.579406:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+5:2347:x1875405868998144:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:3.0:1788526748.579463:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a53a 00000100:00080000:3.0:1788526748.579475:0:6671:0:(import.c:65:import_set_state_nolock()) ffff98c2461f9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526748.579533:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788526748.579921:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2742f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f122900d-e71c-4fc3-b559-b19040da7c34+2:2347:x1875405868998144:12345-192.168.204.59@tcp:9:umount.0 Request processed in 538us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526748.579951:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00010000:00010000:3.0:1788526748.580003:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788526748.580474:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526748.598655:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526748.599144:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999168 00000100:00100000:2.0:1788526748.599161:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999168 00000100:00100000:2.0:1788526748.599249:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 240 00000100:00100000:2.0:1788526748.599260:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+22:2347:x1875405868999168:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:2.0:1788526748.599293:0:5822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a1b3 00000020:00010000:2.0:1788526748.599327:0:5822:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c144017000: total 0 00000100:00080000:2.0:1788526748.599332:0:5822:0:(import.c:65:import_set_state_nolock()) ffff98c144017800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788526748.599357:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788526748.599666:0:7618:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c144017000: total 0 00010000:00010000:1.0:1788526748.599752:0:7618:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c144017000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788526748.599803:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:1.0:1788526748.599808:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526748.599821:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55600/0x367645d450b3aba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595c6 expref: 21 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599847:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c272284e00) 00010000:00010000:1.0:1788526748.599850:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526748.599855:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111600/0x367645d450b3a4bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ea expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599881:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526748.599884:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788526748.599909:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76000/0x367645d450b3b1c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59771 expref: 19 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599927:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526748.599929:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526748.599933:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242c76800/0x367645d450b3aaff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59595 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599946:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526748.599949:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788526748.599952:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54e00/0x367645d450b3ab29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595a3 expref: 17 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599965:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526748.599967:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788526748.599971:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59763 expref: 16 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599982:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526748.599984:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526748.599988:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3ae9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5969f expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.599998:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526748.600001:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526748.600004:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820c00/0x367645d450b3a7fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc594d1 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.600016:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284500) 00010000:00010000:1.0:1788526748.600025:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526748.601402:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3a4a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593e3 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.601472:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98c272284400) 00010000:00010000:1.0:1788526748.601476:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526748.601481:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3aa1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5955d expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.601500:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98c242a8b600) 00010000:00010000:1.0:1788526748.601503:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788526748.601507:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55800/0x367645d450b3a510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ff expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.601526:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98c242a8bb00) 00010000:00010000:1.0:1788526748.601528:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526748.601531:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6e00/0x367645d450b3b0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5972b expref: 10 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.601547:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98c242a8b200) 00010000:00010000:1.0:1788526748.601549:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788526748.601553:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3abbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc595cd expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526748.601579:0:7618:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c144017000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788526748.601613:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526748.601616:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526748.601618:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526748.603954:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f122900d-e71c-4fc3-b559-b19040da7c34+7:2347:x1875405868999168:12345-192.168.204.59@tcp:39:umount.0 Request processed in 4681us (5584us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788526748.603970:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 240 00000001:00100000:3.0:1788526748.718703:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:3.0:1788526748.718711:0:6693:0:(genops.c:885:class_export_put()) final put ffff98c2461fa800/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:0.0:1788526748.718776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2461fa800/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-OST0000 00000020:00000080:0.0:1788526748.718823:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c2461f9000 for lustre-OST0000 00010000:00010000:2.0:1788526748.883719:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526749.907871:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526750.163831:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566464:0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.163910:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526750.163978:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526750.163985:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881566336:0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.164013:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526750.164044:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566464 00000100:00100000:0.0:1788526750.164053:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566464 00000100:00100000:0.0:1788526750.164114:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788526750.164125:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.164185:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566464:12345-0@lo:400:kworker.0 Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526750.164192:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788526750.164232:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526750.164264:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566464:0@lo:400:kworker.0 00000100:00100000:3.0:1788526750.164498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566336 00000100:00100000:3.0:1788526750.164503:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566336 00000100:00100000:3.0:1788526750.164551:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788526750.164558:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881566336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526750.164596:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881566336:12345-0@lo:400:kworker.0 Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526750.164603:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788526750.165054:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881566080:0@lo:400:kworker.0 00000100:00100000:2.0:1788526750.165098:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526750.165133:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881566592:0@lo:400:kworker.0 00000100:00100000:2.0:1788526750.165157:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526750.165175:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526750.165194:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881566208:0@lo:400:kworker.0 00000100:00100000:3.0:1788526750.165304:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566080 00000100:00100000:3.0:1788526750.165310:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566080 00000100:00100000:3.0:1788526750.165338:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788526750.165346:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881566080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.165424:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566592 00000100:00100000:0.0:1788526750.165428:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566592 00000100:00100000:0.0:1788526750.165461:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788526750.165468:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881566592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788526750.165640:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526750.165677:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881566336:0@lo:400:kworker.0 00000100:00100000:1.0:1788526750.165693:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526750.165699:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526750.168946:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881566080:12345-0@lo:400:kworker.0 Request processed in 3589us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526750.168964:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788526750.169465:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2746c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881566592:12345-0@lo:400:kworker.0 Request processed in 3994us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526750.169475:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788526750.171731:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526750.172338:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566848 00000100:00100000:0.0:1788526750.172349:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566848 00000100:00100000:0.0:1788526750.172460:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788526750.172473:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788526750.172523:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526750.172586:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526750.172593:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788526750.174021:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526750.174092:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526750.175118:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526750.175173:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881566720:0@lo:400:kworker.0 00000100:00100000:2.0:1788526750.175231:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526750.175276:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881566080:0@lo:400:kworker.0 00000100:00100000:2.0:1788526750.175290:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881566592:0@lo:400:kworker.0 00000100:00100000:3.0:1788526750.175406:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566208 00000100:00100000:3.0:1788526750.175423:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566208 00000100:00100000:3.0:1788526750.175482:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788526750.175492:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526750.175569:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881566208:12345-0@lo:400:kworker.0 Request processed in 78us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526750.175576:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788526750.175718:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881566208:0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.175882:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566720 00000100:00100000:0.0:1788526750.175886:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566720 00000100:00100000:0.0:1788526750.175928:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788526750.175936:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881566720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.175982:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881566720:12345-0@lo:400:kworker.0 Request processed in 48us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526750.176005:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788526750.176080:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881566720:0@lo:400:kworker.0 00000100:00100000:0.0:1788526750.721669:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526750.721714:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526750.721751:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526750.721791:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526750.721946:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999296 00000100:00100000:2.0:1788526750.721958:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999296 00000100:00100000:2.0:1788526750.722016:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999424 00000100:00100000:2.0:1788526750.722019:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999424 00000100:00100000:2.0:1788526750.722032:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999552 00000100:00100000:2.0:1788526750.722035:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999552 00000100:00100000:2.0:1788526750.722046:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999680 00000100:00100000:2.0:1788526750.722060:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999680 00000100:00100000:2.0:1788526750.722082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526750.722093:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+13:2348:x1875405868999296:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526750.722110:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526750.722133:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045200/0x367645d450b3a2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5931f expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526750.722153:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526750.722217:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+12:2348:x1875405868999296:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 126us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526750.722225:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526750.722244:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526750.722250:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+11:2348:x1875405868999424:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526750.722272:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526750.722282:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044800/0x367645d450b3a2af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59349 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526750.722291:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526750.722307:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+10:2348:x1875405868999424:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 58us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526750.722313:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526750.722353:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1788526750.722360:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+9:2349:x1875405868999552:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526750.722368:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526750.722376:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241663000/0x367645d450b3a46f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc593ce expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526750.722385:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526750.722458:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+8:2349:x1875405868999552:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 98us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526750.722464:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1788526750.722477:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1788526750.722490:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+7:2349:x1875405868999680:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526750.722497:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526750.722506:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821000/0x367645d450b3a2a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59318 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526750.722515:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526750.722532:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e25535f2-071e-428f-98ae-fe60202a1364+6:2349:x1875405868999680:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 50us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526750.722545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1788526750.734774:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526750.734929:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405868999936 00000100:00100000:3.0:1788526750.734959:0:6721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405868999936 00000100:00100000:3.0:1788526750.735049:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:3.0:1788526750.735060:0:6721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+6:2347:x1875405868999936:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:3.0:1788526750.735121:0:6721:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a2bd 00000020:00010000:3.0:1788526750.735130:0:6721:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c27b671800: total 0 00000100:00080000:3.0:1788526750.735134:0:6721:0:(import.c:65:import_set_state_nolock()) ffff98c27b670800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526750.735167:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788526750.735446:0:6721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c144019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5+5:2347:x1875405868999936:12345-192.168.204.59@tcp:39:umount.0 Request processed in 387us (684us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788526750.735455:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00080000:1.0:1788526750.735651:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788526750.735949:0:7617:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c27b671800: total 0 00010000:00010000:2.0:1788526750.735993:0:7617:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c27b671800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788526750.736029:0:7617:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:2.0:1788526750.736033:0:7617:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526750.736043:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820200/0x367645d450b3b1ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5977f expref: 4 pid: 6721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526750.736065:0:7617:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c27b671800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788526750.736076:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526750.736078:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526750.736080:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526750.766045:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526750.766151:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000064 00000100:00100000:2.0:1788526750.766161:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000064 00000100:00100000:2.0:1788526750.766221:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 332 00000100:00100000:2.0:1788526750.766232:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+6:2347:x1875405869000064:12345-192.168.204.59@tcp:251:umount.0 00000020:00000080:2.0:1788526750.766279:0:5815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a190 00000100:00080000:2.0:1788526750.766289:0:5815:0:(import.c:65:import_set_state_nolock()) ffff98c24505c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788526750.766371:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e25535f2-071e-428f-98ae-fe60202a1364+1:2347:x1875405869000064:12345-192.168.204.59@tcp:251:umount.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526750.766379:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 332 00000020:00000080:2.0:1788526750.766432:0:5815:0:(genops.c:885:class_export_put()) final put ffff98c24505d000/e25535f2-071e-428f-98ae-fe60202a1364 00000020:00000080:0.0:1788526750.766583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24505d000/e25535f2-071e-428f-98ae-fe60202a1364 for MGS 00000020:00000080:0.0:1788526750.766625:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24505c000 for MGS 00010000:00010000:3.0:1788526750.767270:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526750.932761:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526751.190437:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526751.190521:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526751.190827:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881566976 00000100:00100000:2.0:1788526751.190836:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881566976 00000100:00100000:2.0:1788526751.190898:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788526751.190922:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526751.190956:0:6673:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526751.191005:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881566976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526751.191012:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788526751.191068:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881566976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788526751.955985:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788526752.808121:0:12909:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788526752.832597:0:12909:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788526752.832665:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.832683:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.832691:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.832699:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.832721:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788526752.832728:0:12909:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788526752.832768:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788526752.832774:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788526752.832782:0:12909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788526752.832836:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c281e73800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788526752.833031:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881567104:0@lo:39:umount.0 00000100:00100000:0.0:1788526752.833126:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788526752.833344:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526752.833353:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833374:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.833378:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833406:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.833415:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.833421:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788526752.833424:0:7617:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788526752.833427:0:7617:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788526752.833483:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833491:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526752.833513:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833535:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662600/0x367645d450b3a23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a246 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833550:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.833552:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.833553:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526752.833568:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881567232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.833609:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526752.833663:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567232 00000100:00100000:2.0:1788526752.833672:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567232 00000100:00100000:2.0:1788526752.833735:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788526752.833760:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3278:x1875405881567232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.833777:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526752.833795:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030400/0x367645d450b3a246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a23f expref: 21 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.833812:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526752.833865:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3278:x1875405881567232:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.833873:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788526752.833916:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881567232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.833963:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567104 00000100:00100000:2.0:1788526752.833967:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567104 00000100:00100000:2.0:1788526752.833995:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788526752.834015:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875405881567104:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788526752.834045:0:5824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f91 00000100:00080000:2.0:1788526752.834064:0:5824:0:(import.c:65:import_set_state_nolock()) ffff98c27b9cf000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788526752.834264:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526752.839275:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3277:x1875405881567104:12345-0@lo:39:umount.0 Request processed in 5253us (6130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.839296:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788526752.839318:0:5824:0:(genops.c:885:class_export_put()) final put ffff98c27b9cf800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788526752.839437:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b9cf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788526752.839506:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b9cf000 for lustre-MDT0000 00000100:00080000:0.0:1788526752.841732:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c281e73800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788526752.841811:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881567104:0@lo:39:umount.0 00000100:00080000:1.0:1788526752.841957:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788526752.841963:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788526752.841969:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788526752.843314:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843338:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843346:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843365:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843537:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526752.843547:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843555:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843562:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.843569:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.843625:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526752.843634:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.843643:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.843648:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.843658:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.843667:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.843674:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788526752.843677:0:5812:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 00010000:00010000:2.0:1788526752.843723:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.843730:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788526752.843797:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881567360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526752.843897:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526752.844021:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567360 00000100:00100000:0.0:1788526752.844030:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567360 00000100:00100000:0.0:1788526752.844103:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526752.844115:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3279:x1875405881567360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788526752.844131:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526752.844149:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282045800/0x367645d450b3a254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a24d expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526752.844171:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526752.844420:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844429:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662e00/0x367645d450b3a24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a254 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844465:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526752.844469:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844475:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030c00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.844479:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844487:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.844494:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.844501:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788526752.844504:0:5812:0:(mgc_request.c:1187:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788526752.844523:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844530:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526752.844549:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.844557:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.844559:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.844562:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526752.844574:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526752.844588:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881567488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.844622:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526752.844676:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788526752.844686:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788526752.844829:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567488 00000100:00100000:2.0:1788526752.844901:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567488 00010000:00010000:1.0:1788526752.845114:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788526752.845131:0:12909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030c00/0x367645d450b3a14a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a151 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526752.845150:0:12909:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788526752.845205:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845213:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845221:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845227:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845246:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526752.845253:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845259:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845266:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845273:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845286:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788526752.845291:0:12909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845305:0:12909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845311:0:12909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845317:0:12909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526752.845326:0:12909:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788526752.845329:0:12909:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788526752.845342:0:12909:0:(mgc_request.c:650:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788526752.845382:0:12909:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788526752.845399:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788526752.845406:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788526752.845413:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788526752.845419:0:12909:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c26e9e3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788526752.845426:0:12909:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98c27fab5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788526752.845434:0:12909:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98c27b671800 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 192.168.204.59@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788526752.845439:0:12909:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff98c144017000 f122900d-e71c-4fc3-b559-b19040da7c34 192.168.204.59@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1788526752.845445:0:12909:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98c27b1f4c80) has exports, disconnecting them 00000020:00080000:1.0:1788526752.845450:0:12909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c26e9e3800), last request at 1788526750 00000020:00000080:1.0:1788526752.845458:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a104 00000100:00080000:1.0:1788526752.845479:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788526752.845528:0:12909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c26e9e3800): rc 0 00000020:00000080:1.0:1788526752.845531:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26e9e3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788526752.845549:0:12909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98c27fab5800), last request at 1788526750 00000020:00000080:1.0:1788526752.845553:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a02b 00000100:00080000:1.0:1788526752.845559:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c27fab2800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788526752.845566:0:12909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27fab5800): rc 0 00000020:00000080:1.0:1788526752.845568:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c27fab5800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788526752.845575:0:12909:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaec702c5fae0 00000100:00080000:1.0:1788526752.845598:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788526752.845601:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788526752.845616:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788526752.845691:0:12909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788526752.845711:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c27fa76800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788526752.845727:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788526752.845729:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788526752.845738:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788526752.845810:0:12909:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788526752.845820:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c243185000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788526752.845957:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788526752.845964:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.845974:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.845977:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.845986:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.845994:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.846071:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788526752.846076:0:7617:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:2.0:1788526752.846078:0:7617:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788526752.846117:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846125:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526752.846140:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846148:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b54a00/0x367645d450b3a461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a468 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846160:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526752.846171:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846178:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c282044200 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.846181:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846188:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.846194:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.846200:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788526752.846202:0:7617:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:2.0:1788526752.846205:0:7617:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788526752.846228:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.846234:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788526752.846282:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c27b1f4c80) has no exports 00000100:00100000:0.0:1788526752.846941:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3279:x1875405881567360:12345-0@lo:103:ldlm_bl.0 Request processed in 2823us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526752.846965:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788526752.847295:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847306:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c282044200/0x367645d450b39ef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b39ef7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847324:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526752.847328:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847334:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526752.847346:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847363:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526752.847370:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526752.847376:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788526752.847378:0:7617:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788526752.847381:0:7617:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788526752.847440:0:7617:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847447:0:7617:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526752.847460:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847466:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c28216c800/0x367645d450b3a25b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a262 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.847477:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.847479:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.847481:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526752.847490:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788526752.847505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e9e3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788526752.847568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27fab5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788526752.847597:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c26e9e6800 for lustre-MDT0000 00000020:00000080:2.0:1788526752.847602:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27fab2800 for lustre-MDT0000 00000100:00100000:2.0:1788526752.847626:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881567872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.847734:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526752.847808:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567872 00000100:00100000:0.0:1788526752.847818:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567872 00000100:00100000:3.0:1788526752.848072:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881567360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526752.848101:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881568128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526752.848132:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526752.848252:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881568000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.848276:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526752.848408:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881568128 00000100:00100000:2.0:1788526752.848413:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881568128 00000100:00100000:2.0:1788526752.848433:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881568000 00000100:00100000:2.0:1788526752.848436:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881568000 00000100:00100000:2.0:1788526752.848451:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526752.848461:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+22:3281:x1875405881567488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.848477:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526752.848497:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54400/0x367645d450b3a151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a14a expref: 22 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.848515:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526752.848552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+21:3281:x1875405881567488:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.848559:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788526752.848575:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526752.848581:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+20:3281:x1875405881567872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.848588:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526752.848598:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821c00/0x367645d450b3a468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a461 expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.848606:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526752.848626:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+19:3281:x1875405881567872:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.848631:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526752.848654:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788526752.848660:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2450f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+18:3279:x1875405881568128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.848667:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526752.848676:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c241662a00/0x367645d450b3a262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a25b expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.848685:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526752.848704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2450f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+17:3279:x1875405881568128:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.848709:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788526752.848748:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526752.848754:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+16:3278:x1875405881568000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.848760:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526752.848768:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240031e00/0x367645d450b39ef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b39ef0 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526752.848779:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526752.848799:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973+15:3278:x1875405881568000:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.848805:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526752.848827:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3278:1875405881568000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.849119:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881567872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526752.849127:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c2746c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3281:1875405881567488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526752.849226:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526752.849294:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526752.849500:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881567616:0@lo:9:umount.0 00000100:00100000:1.0:1788526752.849547:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526752.849582:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881567744:0@lo:9:umount.0 00000100:00100000:1.0:1788526752.849605:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526752.849939:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567616 00000100:00100000:2.0:1788526752.849946:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567616 00000100:00100000:2.0:1788526752.850118:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881567744 00000100:00100000:2.0:1788526752.850122:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881567744 00000100:00100000:3.0:1788526752.850161:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788526752.850171:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1875405881567616:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788526752.850201:0:12011:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a078 00000100:00080000:3.0:1788526752.850211:0:12011:0:(import.c:65:import_set_state_nolock()) ffff98c27fa70000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788526752.850251:0:12011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788526752.850685:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3277:x1875405881567616:12345-0@lo:9:umount.0 Request processed in 515us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526752.850694:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788526752.850714:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788526752.850756:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27fa76800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788526752.850771:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788526752.850774:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788526752.850779:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881567616:0@lo:9:umount.0 00000100:00080000:1.0:1788526752.850869:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788526752.850874:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788526752.851134:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788526752.851144:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875405881567744:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788526752.851163:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a17b 00000100:00080000:2.0:1788526752.851172:0:8450:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788526752.851204:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788526752.851347:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274962680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3277:x1875405881567744:12345-0@lo:9:umount.0 Request processed in 205us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526752.851364:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1788526752.851384:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526752.851436:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e62f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881568128:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788526752.851558:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c243185000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788526752.851576:0:3277:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788526752.851578:0:3277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788526752.851582:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881567744:0@lo:9:umount.0 00000020:00080000:0.0:1788526752.859227:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98c27b1f4c80) has no exports 00000020:00000080:0.0:1788526752.952030:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f4b 00000020:00000080:0.0:1788526752.952051:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c281e3a800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788526752.952077:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788526752.952147:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281e3a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788526752.952202:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788526752.952217:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788526752.952222:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98c245b3cc80) has no exports 00000020:00000080:1.0:1788526752.952631:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f44 00000020:00000080:1.0:1788526752.952642:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26d8c8800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788526752.952706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26d8c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788526752.952757:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788526752.952767:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788526752.952771:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c281ea1000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788526752.952773:0:12909:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281ea1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788526752.952779:0:12909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788526752.979717:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526753.314717:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1788526753.314749:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000001:00080000:1.0:1788526753.314756:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788526753.314762:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000001:00080000:1.0:1788526753.314769:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788526753.314773:0:5844:0:(genops.c:885:class_export_put()) final put ffff98c27b671800/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 00000020:00000080:1.0:1788526753.314790:0:5844:0:(genops.c:885:class_export_put()) final put ffff98c144017000/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:2.0:1788526753.316155:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b671800/5bb5a2e3-022e-4ae7-a1c3-cb46c29354f5 for lustre-MDT0000 00000020:00000080:2.0:1788526753.316237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c144017000/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-MDT0000 00000020:00000080:2.0:1788526753.316276:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b670800 for lustre-MDT0000 00000020:00000080:2.0:1788526753.316281:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c144017800 for lustre-MDT0000 00000001:00100000:0.0:1788526753.325832:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788526753.325848:0:7631:0:(genops.c:885:class_export_put()) final put ffff98c27b7b7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788526753.325886:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:0.0:1788526753.325889:0:7631:0:(genops.c:885:class_export_put()) final put ffff98c274ba5000/f122900d-e71c-4fc3-b559-b19040da7c34 00000020:00000080:2.0:1788526753.326657:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b7b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788526753.326712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c274ba5000/f122900d-e71c-4fc3-b559-b19040da7c34 for lustre-OST0001 00000020:00000080:2.0:1788526753.326735:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7b0800 for lustre-OST0001 00000020:00000080:2.0:1788526753.326739:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c242c2e000 for lustre-OST0001 00000001:00100000:3.0:1788526753.809085:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788526753.809097:0:6693:0:(genops.c:885:class_export_put()) final put ffff98c27fa73800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788526753.809236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27fa73800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788526753.809292:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27fa70000 for lustre-OST0000 00010000:00010000:0.0:1788526754.003610:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788526754.963538:0:12909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c242db9ba0 - data ffff98c27ff626c0/ffff98c245542800 00000020:01000000:1.0:1788526754.963692:0:12909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c258026900 - data ffff98c256c351b0/ffff98c249619400 00000001:00000004:1.0:1788526754.969933:0:12909:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:3.0:1788526755.027878:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788526755.055184:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788526755.055194:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788526755.055659:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788526755.055663:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788526755.056024:0:6719:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788526755.056029:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788526755.056039:0:6719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788526755.056979:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788526755.056984:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788526755.057013:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788526755.057016:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788526755.057234:0:7906:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788526755.057238:0:7906:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788526755.057247:0:7906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788526755.084502:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f13 00000020:00000080:0.0:1788526755.084516:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26ee15800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788526755.085682:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f28 00000020:00000080:0.0:1788526755.085691:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26ee16000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788526755.085698:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788526755.085704:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.085713:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788526755.085718:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98c27b1f0000) has no exports 00000004:01000000:0.0:1788526755.085884:0:12909:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788526755.085892:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a174 00000020:00000080:0.0:1788526755.085896:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c144012000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788526755.085900:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788526755.085914:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.085920:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788526755.085923:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98c142aa4c80) has no exports 00000020:00000080:0.0:1788526755.085930:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a16d 00000020:00000080:0.0:1788526755.085934:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c243186000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788526755.086240:0:12909:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788526755.086245:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788526755.086249:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788526755.086256:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788526755.086258:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788526755.086290:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.086297:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788526755.086302:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a071 00000020:00000080:0.0:1788526755.086307:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c27f58f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788526755.086310:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788526755.086330:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.086333:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788526755.086335:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98c249710000) has no exports 00000020:00000080:0.0:1788526755.086339:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a06a 00000020:00000080:0.0:1788526755.086342:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c27fa74800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788526755.086682:0:12909:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788526755.086686:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788526755.086688:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788526755.086691:0:12909:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788526755.086693:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788526755.086718:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.086723:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788526755.086744:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.086748:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788526755.086771:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f2f 00000020:00000080:0.0:1788526755.086776:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26ee17000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788526755.086780:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788526755.086790:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.086793:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788526755.086796:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98c27b1f1980) has no exports 00000020:00000080:0.0:1788526755.086817:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.086820:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788526755.086825:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f36 00000020:00000080:0.0:1788526755.086828:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26ee10800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788526755.086835:0:12909:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c248515800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788526755.086839:0:12909:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c248515800 3 00000020:01000004:0.0:1788526755.086842:0:12909:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff98c248515800 from lustre-MDT0000 00000020:00000080:0.0:1788526755.086859:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.086862:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788526755.086864:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c26ee12800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788526755.086867:0:12909:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee12800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788526755.086875:0:12909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788526755.086937:0:12909:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788526755.086941:0:12909:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788526755.086944:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788526755.086946:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.086949:0:12909:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788526755.086955:0:12909:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98c249720800 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 0@lo 14 (0 0 9) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788526755.086959:0:12909:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98c24967cc80) has exports, disconnecting them 00000020:00080000:0.0:1788526755.086963:0:12909:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98c249720800), last request at 1788526496 00000020:00000080:0.0:1788526755.086975:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39ed4 00000020:00010000:0.0:1788526755.086979:0:12909:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98c249720800: total 8 00000100:00080000:0.0:1788526755.086982:0:12909:0:(import.c:65:import_set_state_nolock()) ffff98c249727000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788526755.086993:0:12909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c249720800): rc 0 00000020:00080000:0.0:1788526755.086997:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98c24967cc80) has no exports 00000100:00100000:0.0:1788526755.087057:0:5818:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98c245ea8800:5818] 2 exiting: rc = 0 00000020:00000080:2.0:1788526755.087412:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee15800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788526755.087425:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee16000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788526755.087429:0:37:0:(genops.c:885:class_export_put()) final put ffff98c24317b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788526755.087431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24317b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788526755.087434:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788526755.087544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c144012000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788526755.087549:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c243186000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788526755.087558:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c243185000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788526755.087562:0:37:0:(genops.c:885:class_export_put()) final put ffff98c26e9e0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788526755.087564:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e9e0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788526755.087567:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788526755.087595:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27f58f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788526755.087599:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27fa74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788526755.087603:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27fa76800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788526755.087607:0:37:0:(genops.c:885:class_export_put()) final put ffff98c26ee17800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788526755.087608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee17800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788526755.087611:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788526755.087666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee17000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788526755.087669:0:37:0:(genops.c:885:class_export_put()) final put ffff98c26ee16800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788526755.087671:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee16800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788526755.087674:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788526755.087807:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee10800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788526755.087821:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98c249720800: total 0 00010000:00010000:2.0:1788526755.087824:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526755.087840:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98c249720800, canceled 0 locks, left on hash table 9. 00010000:00010000:2.0:1788526755.087878:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c282044c00/0x367645d450b39fde lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b39fd7 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087898:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242c76e00/0x367645d450b3a45a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a453 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087909:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b54c00/0x367645d450b3a22a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a223 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087919:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240030e00/0x367645d450b3a238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a231 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087929:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242b55000/0x367645d450b3a207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a200 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087938:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240031400/0x367645d450b3a215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a20e expref: 5 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087948:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c28216c000/0x367645d450b3a1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a1dd expref: 4 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087959:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242c76600/0x367645d450b3a44c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a445 expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087971:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c240031600/0x367645d450b3a1f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x367645d450b3a1eb expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526755.087981:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98c249720800, canceled 9 locks, left on hash table 0. 00000020:00000080:2.0:1788526755.087992:0:5812:0:(genops.c:885:class_export_put()) final put ffff98c249720800/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 00010000:00010000:2.0:1788526755.088002:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526755.088004:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526755.088011:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526755.088040:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98c245ea9800:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1788526755.090847:0:5817:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98c249bee400:5817] 1 exiting: rc = 0 00000020:00000080:0.0:1788526755.095237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c249720800/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 for MGS 00000100:00100000:1.0:1788526755.095534:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095544:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095550:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095555:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095561:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095567:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095575:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095580:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095585:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095590:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095597:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095603:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095607:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095613:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095631:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095636:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095641:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095646:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095652:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095658:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095664:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095669:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095675:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095680:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095686:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095692:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095697:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095702:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095707:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095713:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095718:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095723:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095728:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095734:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095739:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095744:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095749:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095754:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095760:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095765:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095771:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095777:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095783:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095788:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095793:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095799:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095804:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095810:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095814:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095828:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095833:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095838:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095844:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095849:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095854:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095859:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095864:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095870:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095875:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095881:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095886:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095891:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095897:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.095903:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788526755.096285:0:12909:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788526755.096289:0:12909:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1788526755.097090:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c249727000 for MGS 00000020:01000000:1.0:1788526755.097269:0:12909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c27f71d660 - data ffff98c256e6b0d8/ffff98c27b535400 00000020:01000000:0.0:1788526755.097575:0:12909:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c2459057e0 - data ffff98c2573dca20/ffff98c242de2000 00000020:00000080:0.0:1788526755.098113:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39eb8 00000020:00000080:0.0:1788526755.098121:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c242bf1800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788526755.098177:0:12909:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c248515800 from MGS, refs=2 00000020:01000004:0.0:1788526755.098181:0:12909:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c248515800 2 00000020:01000004:0.0:1788526755.098184:0:12909:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff98c248515800 from MGS 00000020:00000080:0.0:1788526755.098209:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526755.098215:0:12909:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788526755.098218:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c2482eb000/MGS 00000020:00000080:0.0:1788526755.098221:0:12909:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2482eb000/MGS for MGS 00000020:01000000:0.0:1788526755.098227:0:12909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788526755.098291:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788526755.098296:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526755.098301:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788526755.098308:0:12909:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98c281e70000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788526755.098325:0:12909:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff98c249679980) has exports, disconnecting them 00000020:00080000:0.0:1788526755.098330:0:12909:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98c281e70000), last request at 1788526497 00000020:00000080:0.0:1788526755.098334:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39f83 00000020:00080000:0.0:1788526755.098343:0:12909:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c281e70000): rc 0 00000020:00000080:0.0:1788526755.098348:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c281e70000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788526755.098426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c242bf1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788526755.099231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281e70000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788526755.129309:0:12909:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788526755.129330:0:12909:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788526755.129334:0:12909:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788526755.129342:0:12909:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788526755.129784:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788526755.129793:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788526755.129800:0:12909:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c248515800 1 00000020:00000080:1.0:1788526755.129807:0:12909:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39eaa 00000020:00000080:1.0:1788526755.129816:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c2482eb800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788526755.129826:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788526755.129831:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788526755.129836:0:12909:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788526755.129839:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98c245b38000) has no exports 00000020:00000080:2.0:1788526755.129942:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c281e73800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788526755.129949:0:37:0:(genops.c:885:class_export_put()) final put ffff98c281e71000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788526755.129952:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c281e71000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788526755.129971:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788526755.130031:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c2482eb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788526755.178298:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788526755.178326:0:12909:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788526755.178333:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c248516800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788526755.178338:0:12909:0:(genops.c:844:class_export_destroy()) destroying export ffff98c248516800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788526755.178346:0:12909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788526755.178508:0:12909:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff98c248512800 00000020:01000000:2.0:1788526755.178529:0:12909:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788526755.178535:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788526755.178539:0:12909:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788526755.178543:0:12909:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98c249716600) has no exports 00000100:00100000:2.0:1788526755.178630:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98c24bf58600:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1788526755.178748:0:5824:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98c24829b400:5824] 2 exiting: rc = 0 00000100:00100000:2.0:1788526755.178804:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98c250d91c00:5822] 0 exiting: rc = 1 00000100:00100000:3.0:1788526755.179575:0:6721:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98c25081de00:6721] 3 exiting: rc = 0 00000100:00100000:2.0:1788526755.179948:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179956:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179962:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179968:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179973:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179979:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.179985:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180002:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180007:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180013:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180018:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180032:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180039:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180044:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180051:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180056:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180146:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180152:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180157:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180161:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180166:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180171:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180177:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180181:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180187:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180192:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180198:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180204:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180209:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180215:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180220:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180225:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180229:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180235:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180239:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180244:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180249:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180254:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180259:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180263:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180268:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180272:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180287:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180292:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180296:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180301:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180307:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180323:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180329:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180334:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180339:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180344:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180349:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180354:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180358:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180364:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180370:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180375:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180381:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180405:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180411:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180416:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180422:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.180427:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.188789:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98c242d27a00:5826] 1 exiting: rc = 0 00000100:00100000:1.0:1788526755.191425:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98c249771200:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1788526755.191591:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191600:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191607:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191614:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191621:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191627:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191648:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191654:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191661:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191667:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191672:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191678:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191685:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191691:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191696:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191701:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191707:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191711:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191716:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191721:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191727:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191732:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191737:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191742:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191747:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191753:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191758:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191764:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191769:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191775:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191780:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191785:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191790:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191795:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191800:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191804:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191809:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191814:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191820:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191825:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191831:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191843:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191849:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191854:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191859:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191864:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191869:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191876:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191883:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191888:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191894:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191899:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191904:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191909:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191914:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191919:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191924:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191929:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191933:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191939:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191943:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191948:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.191953:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.192038:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.194816:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98c247f2f000:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1788526755.194944:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98c247f2f600:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1788526755.195188:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195200:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195206:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195214:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195220:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195226:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195233:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195240:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195265:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195272:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195278:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195283:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195302:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195307:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195324:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195331:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195337:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195343:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195349:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195355:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195377:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195407:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195416:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195421:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195428:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195435:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195440:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195446:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195452:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195458:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195463:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195469:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195489:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195496:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195501:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195507:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195514:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195520:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195526:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195532:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195537:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195543:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195550:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195556:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195579:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195586:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195592:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195605:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195612:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195620:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195627:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195635:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195641:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195648:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195655:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195662:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195685:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195695:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195701:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195707:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195714:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195719:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195725:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.195731:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526755.212717:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98c24976a800:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1788526755.212841:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98c24976b000:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788526755.212980:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.212987:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.212993:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.212998:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213014:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213020:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213271:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213277:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213283:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213288:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213294:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213298:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213304:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213320:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213326:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213331:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213336:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213341:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213346:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213352:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213356:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213360:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213366:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213370:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213375:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213380:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213490:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213498:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213503:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213507:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213512:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213518:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213523:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213527:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213533:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213538:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213542:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213547:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213552:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213566:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213571:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213576:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213581:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213585:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213590:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213595:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213600:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213605:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213610:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213615:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213620:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213625:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213631:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213636:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213641:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213646:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213651:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213656:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213661:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213666:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213671:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213676:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213681:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.213686:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.214513:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98c24976ac00:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1788526755.214878:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98c24976b400:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1788526755.214951:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214958:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214963:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214968:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214973:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214978:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214983:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214988:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214993:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.214997:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215017:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215383:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215564:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215570:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215575:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215581:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215586:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215591:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215597:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215602:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215607:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215613:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215619:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215624:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215639:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215645:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215651:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215656:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215661:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215666:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215671:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215675:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215680:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215685:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215692:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215697:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215702:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215708:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215714:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215720:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215725:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215731:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215743:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215748:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215753:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215768:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215774:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215779:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215783:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215788:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215792:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215797:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215801:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215806:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215812:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215817:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215823:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215828:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215833:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215838:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215842:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215847:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215851:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.215856:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.216637:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98c24976a000:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1788526755.216950:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98c24976bc00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1788526755.217948:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217956:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217961:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217966:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217971:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217976:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217981:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217985:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217990:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217995:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.217999:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218004:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218009:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218014:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218019:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218303:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218337:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218342:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218347:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218352:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218357:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218362:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218368:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218372:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218377:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218382:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218475:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218480:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218485:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218490:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218495:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218501:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218506:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218511:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218517:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218522:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218527:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218532:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218538:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218543:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218548:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218553:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218558:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218563:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218569:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218574:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218580:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218585:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218590:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218595:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218600:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218613:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218619:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218624:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218629:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218633:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218638:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218643:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218648:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218653:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218657:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218662:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218667:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.218672:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526755.219904:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98c24975c800:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788526755.220640:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98c24975a000:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788526755.225635:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98c24975bc00:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1788526755.225804:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225813:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225819:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225825:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225830:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225836:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225843:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225850:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225856:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225861:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225867:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225873:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225879:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225885:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225892:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225898:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225904:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225910:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225917:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225923:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225929:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225953:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225969:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225976:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225981:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225987:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225992:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.225998:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226003:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226009:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226015:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226021:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226026:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226032:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226037:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226056:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226378:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226440:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226451:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226456:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226465:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226476:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226481:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226490:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226497:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226503:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226525:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226532:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226537:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226543:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226549:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226555:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226561:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226566:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226573:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226578:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226594:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226601:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226606:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226611:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226616:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226621:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226627:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788526755.226632:0:12909:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788526755.232922:0:12909:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788526755.232941:0:12909:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788526755.232947:0:12909:0:(genops.c:885:class_export_put()) final put ffff98c243178000/MDS_uuid 00000020:00000080:1.0:1788526755.232952:0:12909:0:(genops.c:844:class_export_destroy()) destroying export ffff98c243178000/MDS_uuid for MDS 00000020:01000000:1.0:1788526755.232962:0:12909:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788526755.233364:0:12909:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788526755.284932:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881568256:0@lo:400:kworker.0 00000400:00000100:1.0:1788526755.285704:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875405881568256 offset 0 length 224: 4 00000100:00100000:1.0:1788526755.285766:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526755.285775:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881568384:0@lo:400:kworker.0 00000400:00000100:1.0:1788526755.285805:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881568384 offset 0 length 224: 4 00000100:00100000:1.0:1788526755.285836:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881568512:0@lo:400:kworker.0 00000400:00000100:1.0:1788526755.285859:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881568512 offset 0 length 224: 4 00010000:00010000:2.0:1788526756.051567:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788526756.564568:0:5820:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788526756.564585:0:5820:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c274ba0000 from MGS 00000020:01000004:1.0:1788526756.564592:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788526756.564612:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98c142aa1980) 00000020:00000080:1.0:1788526756.564634:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type mgs with refcount 2 00000020:01000004:1.0:1788526756.564724:0:5820:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c274ba0000 from MGS, refs=3 00080000:01000000:1.0:1788526756.564734:0:5820:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788526756.564742:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x367645d450b3b1f8 00010000:00010000:1.0:1788526756.564917:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-2 is initialized 00000040:01000000:1.0:1788526756.566013:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788526756.566371:0:5820:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788526756.566779:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526756.566953:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788526756.566960:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788526756.567319:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788526756.567328:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788526756.573594:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788526756.573614:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788526756.580518:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00010000:00010000:0.0:1788526757.076369:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526758.106563:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788526758.220640:0:13067:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788526758.228461:0:13067:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788526758.228539:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526758.228558:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526758.228567:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526758.228574:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526758.228596:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788526758.228621:0:13067:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-client 10000000:01000000:1.0:1788526758.228626:0:13067:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788526758.228652:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788526758.228787:0:13067:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274960000 x1875405881568384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526771 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526758.228806:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788526758.228854:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881568384:0@lo:400:kworker.0 00000100:00080000:1.0:1788526758.228889:0:13067:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788526758.228922:0:13067:0:(import.c:65:import_set_state_nolock()) ffff98c27fac8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788526758.229913:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526758.229923:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526758.229934:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663c00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:0.0:1788526758.229940:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526758.229952:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526758.229984:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526758.229990:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788526758.229994:0:5812:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788526758.229997:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788526758.230215:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526758.230224:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788526758.230249:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526758.230268:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663c00/0x367645d450b3a20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x367645d450b3a215 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526758.230282:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526758.230285:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526758.230286:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526758.230309:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881568768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788526758.230891:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526758.231021:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881568640:0@lo:39:umount.0 00000400:00000100:3.0:1788526758.231058:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881568640 offset 0 length 224: 4 00000100:00100000:1.0:1788526758.231147:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881568768 00000100:00100000:1.0:1788526758.231158:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881568768 00000100:00100000:1.0:1788526758.231247:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788526758.231279:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3279:x1875405881568768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788526758.231286:0:5810:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788526758 with bad export cookie 3924400903489298132 00000100:00100000:1.0:1788526758.241746:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3279:x1875405881568768:12345-0@lo:103:ldlm_bl.0 Request processed in 10454us (10845us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788526758.241765:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788526758.241906:0:3279:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788526758.241913:0:3279:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788526758.241918:0:3279:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788526758.251834:0:3279:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.159@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788526758.251843:0:3279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788526758.251857:0:3279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274962a00 x1875405881568256/t0(0) o400->MGC192.168.204.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788526771 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526758.251924:0:3279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27b8e0e00 x1875405881568768/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788526774 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788526758.251936:0:3279:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788526758.251939:0:3279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788526758.251941:0:3279:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788526758.251946:0:3279:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788526758.251952:0:3279:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:0.0:1788526758.251963:0:3279:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c24317f800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526758.252438:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3280:1875405881568256:0@lo:400:kworker.0 00000100:00100000:1.0:1788526758.252531:0:3279:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274962a00 x1875405881568896/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526758.252574:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3279:1875405881568768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526758.252665:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881568896:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:3.0:1788526758.252754:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526758.252873:0:12985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881568896 00000100:00100000:1.0:1788526758.252885:0:12985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881568896 00000100:00100000:1.0:1788526758.252948:0:12985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526758.252957:0:12985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26d89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881568896:12345-0@lo:250:ptlrpcd_00_01.0 00010000:00000400:1.0:1788526758.252980:0:12985:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788526758.265693:0:12985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26d89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881568896:12345-0@lo:250:ptlrpcd_00_01.0 Request processed in 12723us (12926us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788526758.265712:0:12985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788526758.266049:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788526758.266057:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788526758.266062:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881568896:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:2.0:1788526759.123919:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526760.153955:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788526760.405237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788526760.405252:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788526760.405258:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788526760.405268:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 393 00000100:00080000:3.0:1788526760.405276:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788526760.405316:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c24317f800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526760.405365:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274778e00 x1875405881569024/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526760.405486:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526760.405505:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881569152:0@lo:400:kworker.0 00000400:00000100:3.0:1788526760.405583:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881569152 offset 0 length 224: 4 00000100:00100000:1.0:1788526760.405735:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569024:0@lo:250:kworker.0 00000100:00100000:1.0:1788526760.405788:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526760.406900:0:12988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881569024 00000100:00100000:3.0:1788526760.406915:0:12988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881569024 00000100:00100000:3.0:1788526760.406979:0:12988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526760.406989:0:12988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26d899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3277:x1875405881569024:12345-0@lo:250:kworker.0 00010000:00000400:3.0:1788526760.407015:0:12988:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:3.0:1788526760.428594:0:12988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26d899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3277:x1875405881569024:12345-0@lo:250:kworker.0 Request processed in 21591us (22792us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788526760.428612:0:12988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788526760.431252:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788526760.431270:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788526760.431276:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569024:0@lo:250:kworker.0 00010000:00010000:3.0:1788526761.171817:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526762.196474:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526763.219591:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526764.243593:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526765.267563:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788526765.524656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788526765.524667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788526765.524670:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788526765.524678:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 395 00000100:00080000:3.0:1788526765.524683:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788526765.524691:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c24317f800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526765.524727:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27477b480 x1875405881569280/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526765.524809:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526765.524815:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569280:0@lo:250:kworker.0 00000100:00100000:1.0:1788526765.524910:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526765.524988:0:12985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881569280 00000100:00100000:1.0:1788526765.524996:0:12985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881569280 00000100:00100000:3.0:1788526765.525004:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881569408:0@lo:400:kworker.0 00000100:00100000:1.0:1788526765.525035:0:12985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526765.525044:0:12985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26d898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881569280:12345-0@lo:250:kworker.0 00000400:00000100:3.0:1788526765.525052:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881569408 offset 0 length 224: 4 00010000:00000400:1.0:1788526765.525063:0:12985:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788526765.548622:0:12985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26d898c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881569280:12345-0@lo:250:kworker.0 Request processed in 23568us (23703us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788526765.548636:0:12985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788526765.549037:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788526765.549044:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788526765.549049:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569280:0@lo:250:kworker.0 00010000:00010000:0.0:1788526766.291870:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526767.316100:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526768.339717:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526768.595821:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526758/real 1788526758] req@ffff98c274960000 x1875405881568640/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788526768 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526768.595858:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c274960000 x1875405881568640/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788526768 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788526768.595873:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27fac8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788526768.595893:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881568640:0@lo:39:umount.0 00000100:00080000:0.0:1788526768.596029:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788526768.596036:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788526768.596041:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788526768.597701:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597718:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597726:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597733:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597755:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788526768.597771:0:13067:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-OST0000 00010000:00010000:0.0:1788526768.597777:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597803:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597810:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597816:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597835:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788526768.597842:0:13067:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear params 00010000:00010000:0.0:1788526768.597847:0:13067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597854:0:13067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597860:0:13067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597867:0:13067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526768.597963:0:13067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788526768.598066:0:13067:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788526768.598070:0:13067:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788526768.598091:0:13067:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788526768.598095:0:13067:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788526768.598100:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526768.598112:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788526768.598117:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98c249713300) has no exports 00000020:00080000:0.0:1788526768.598142:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98c249713300) has no exports 00010000:00010000:1.0:1788526768.600724:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788526768.600741:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600754:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030800 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526768.600759:0:7618:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600772:0:7618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526768.600781:0:7618:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526768.600813:0:7618:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788526768.600816:0:7618:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 10000000:01000000:1.0:1788526768.600820:0:7618:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788526768.600884:0:7618:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:1.0:1788526768.600889:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600897:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030800/0x367645d450b3a223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a22a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600916:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526768.600920:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600926:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662200 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526768.600929:0:7618:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.600936:0:7618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526768.600942:0:7618:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526768.601209:0:7618:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788526768.601212:0:7618:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788526768.601214:0:7618:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788526768.601359:0:7618:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:1.0:1788526768.601364:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601544:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662200/0x367645d450b3a453 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a45a expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601558:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526768.601562:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601569:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241662400 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526768.601573:0:7618:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601581:0:7618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526768.601589:0:7618:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526768.601596:0:7618:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788526768.601599:0:7618:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788526768.601601:0:7618:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788526768.601621:0:7618:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:1.0:1788526768.601625:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601632:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241662400/0x367645d450b3a231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a238 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526768.601641:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526768.601643:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526768.601651:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788526768.603027:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c245e7eea0 - data ffff98c256e88a20/ffff98c27b9c3000 00000020:01000000:0.0:1788526768.603600:0:13067:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c2606e3d20 - data ffff98c256f861b0/ffff98c27cfd0400 00010000:00010000:3.0:1788526768.604152:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526768.607720:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788526768.622701:0:13067:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788526768.686224:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39ffa 00000020:00000080:2.0:1788526768.686236:0:13067:0:(genops.c:885:class_export_put()) final put ffff98c26ee13800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788526768.686247:0:13067:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c27453b800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788526768.686252:0:13067:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c27453b800 2 00000020:01000004:2.0:1788526768.686255:0:13067:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff98c27453b800 from lustre-OST0000 00000020:00000080:2.0:1788526768.686282:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788526768.686305:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788526768.686308:0:13067:0:(genops.c:885:class_export_put()) final put ffff98c27b9cc800/lustre-OST0000_UUID 00000020:00000080:2.0:1788526768.686312:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b9cc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788526768.686321:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788526768.686373:0:13067:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788526768.686378:0:13067:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788526768.686382:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788526768.686426:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788526768.686434:0:13067:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98c27facf000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788526768.686440:0:13067:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff98c245b3b300) has exports, disconnecting them 00000020:00080000:2.0:1788526768.686445:0:13067:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98c27facf000), last request at 1788526519 00000020:00000080:2.0:1788526768.686449:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a024 00000020:00080000:2.0:1788526768.686456:0:13067:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27facf000): rc 0 00000020:00000080:2.0:1788526768.686461:0:13067:0:(genops.c:885:class_export_put()) final put ffff98c27facf000/lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788526768.687026:0:13067:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788526768.687031:0:13067:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788526768.687036:0:13067:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788526768.687041:0:13067:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788526768.687169:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788526768.687174:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788526768.687178:0:13067:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c27453b800 1 00000020:00000080:2.0:1788526768.687196:0:13067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39fb4 00000020:00000080:2.0:1788526768.687201:0:13067:0:(genops.c:885:class_export_put()) final put ffff98c27453b000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788526768.687204:0:13067:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788526768.687207:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788526768.687210:0:13067:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788526768.687212:0:13067:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98c245b39980) has no exports 00000020:00000080:3.0:1788526768.687966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26ee13800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788526768.687982:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27facf000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788526768.687987:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27fac8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788526768.687993:0:36:0:(genops.c:885:class_export_put()) final put ffff98c27facd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788526768.687994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27facd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788526768.687998:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788526768.688070:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27453b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788526768.720933:0:13067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788526768.720949:0:13067:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788526768.720956:0:13067:0:(genops.c:885:class_export_put()) final put ffff98c27453c800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788526768.720961:0:13067:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27453c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788526768.720968:0:13067:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788526768.721118:0:13067:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff98c27453f800 00000020:02000400:3.0:1788526768.721182:0:13067:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788526769.367439:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526770.387920:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526770.643576:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788526770.643588:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788526770.643592:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788526770.643602:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 400 00000100:00080000:1.0:1788526770.643608:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788526770.643616:0:36:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c24317f800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526770.643672:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274960000 x1875405881569536/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526770.643746:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526770.643765:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881569664:0@lo:400:kworker.0 00000400:00000100:1.0:1788526770.643827:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881569664 offset 0 length 224: 4 00000100:00100000:3.0:1788526770.644088:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569536:0@lo:250:kworker.0 00000100:00100000:3.0:1788526770.644127:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526770.644272:0:12988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881569536 00000100:00100000:1.0:1788526770.644281:0:12988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881569536 00000100:00100000:1.0:1788526770.644321:0:12988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526770.644328:0:12988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26d89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3277:x1875405881569536:12345-0@lo:250:kworker.0 00010000:00000400:1.0:1788526770.644344:0:12988:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:1.0:1788526770.676039:0:12988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26d89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3277:x1875405881569536:12345-0@lo:250:kworker.0 Request processed in 31700us (31900us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788526770.676055:0:12988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788526770.676899:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788526770.676907:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:3.0:1788526770.676912:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569536:0@lo:250:kworker.0 00010000:00010000:2.0:1788526771.413980:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788526771.668323:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526755/real 1788526755] req@ffff98c274963800 x1875405881568512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788526771 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526771.718123:0:3278:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff98c274963800 x1875405881568512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788526771 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788526771.718141:0:3278:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788526771.718165:0:3278:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788526771.742208:0:3278:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788526771.742355:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881568512:0@lo:400:kworker.0 00000100:00080000:3.0:1788526771.745865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788526771.745877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788526771.745888:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788526771.745898:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 405 00000100:00080000:3.0:1788526771.745912:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788526771.745921:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c24317f800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526771.745958:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27477b480 x1875405881569792/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788526771.745999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788526771.746003:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788526771.746005:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788526771.746008:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 179 00000100:00080000:3.0:1788526771.746014:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c27b7b1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526771.748214:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27477bb80 x1875405881569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526771.753742:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569792:0@lo:250:kworker.0 00000100:00100000:1.0:1788526771.753848:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526771.753908:0:12985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881569792 00000100:00100000:0.0:1788526771.753919:0:12985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881569792 00000100:00100000:1.0:1788526771.753930:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881569920:0@lo:38:kworker.0 00000400:00000100:1.0:1788526771.753957:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875405881569920 offset 0 length 520: 4 00000100:00100000:0.0:1788526771.753966:0:12985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788526771.753976:0:12985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26d89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881569792:12345-0@lo:250:kworker.0 00010000:00000400:0.0:1788526771.754012:0:12985:0:(ldlm_lib.c:1248:target_handle_connect()) MGS: refusing connection from 0@lo: this is an MGS follower, which only serves clients that support it: rc = -19 00000100:00100000:0.0:1788526771.754068:0:12985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26d89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881569792:12345-0@lo:250:kworker.0 Request processed in 91us (219us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788526771.754077:0:12985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788526771.754372:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788526771.754378:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-19) 00000100:00100000:1.0:1788526771.754382:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e25fea5-99a8-4b5c-8bc5-29a9e4b24973:3277:1875405881569792:0@lo:250:kworker.0 00000020:01000004:3.0:1788526771.862778:0:13222:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788526771.883158:0:13222:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788526771.883382:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.883426:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.883435:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.883442:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.883469:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788526771.883489:0:13222:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-client 10000000:01000000:2.0:1788526771.883494:0:13222:0:(mgc_request.c:650:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788526771.883519:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788526771.883534:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274778700 x1875405881569152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526776 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883556:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274778e00 x1875405881569408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526781 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883583:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274961f80 x1875405881569664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526786 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883615:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27477bb80 x1875405881569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788526781 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883626:0:13222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788526771.883666:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881569408:0@lo:400:kworker.0 00000100:00080000:2.0:1788526771.883706:0:13222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788526771.883712:0:13222:0:(import.c:65:import_set_state_nolock()) ffff98c27b7b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788526771.883718:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788526771.883723:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274778700 x1875405881569152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526776 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883731:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c274961f80 x1875405881569664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526786 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883737:0:13222:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98c27477bb80 x1875405881569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788526781 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526771.883743:0:13222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788526771.883746:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788526771.883778:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526771.883787:0:7617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.883797:0:7617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c240030600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:0.0:1788526771.883801:0:7617:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.883812:0:7617:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526771.883821:0:7617:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526771.883827:0:7617:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788526771.883837:0:7617:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788526771.883840:0:7617:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788526771.884058:0:7617:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:0.0:1788526771.884063:0:7617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.884070:0:7617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030600/0x367645d450b3a1dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a1e4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.884082:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526771.884084:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526771.884085:0:7617:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526771.884106:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881569664:0@lo:400:kworker.0 00000100:00100000:1.0:1788526771.884823:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3281:1875405881569152:0@lo:400:kworker.0 00000100:00100000:1.0:1788526771.884859:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881569920:0@lo:38:kworker.0 00010000:00010000:2.0:1788526771.887861:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887880:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887887:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887894:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887936:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788526771.887955:0:13222:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-OST0001 00010000:00010000:2.0:1788526771.887962:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887970:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887976:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.887983:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.888013:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788526771.888022:0:13222:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear params 00010000:00010000:2.0:1788526771.888028:0:13222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.888034:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526771.888036:0:13222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.888045:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.888047:0:13222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526771.888066:0:13222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.888111:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526771.888118:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.888125:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526771.888129:0:7618:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.888138:0:7618:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526771.888145:0:7618:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526771.888162:0:7618:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788526771.888164:0:7618:0:(mgc_request.c:1180:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788526771.888166:0:7618:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788526771.888213:0:7618:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:1.0:1788526771.888217:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.888224:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c26e820a00/0x367645d450b3a445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a44c expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.888516:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526771.888519:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526771.888522:0:7618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526771.888957:0:13222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788526771.888981:0:13222:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.204.159@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788526771.888995:0:13222:0:(mgc_request.c:650:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788526771.889018:0:13222:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788526771.889023:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788526771.889028:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788526771.889035:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788526771.889040:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98c27b1f6600) has no exports 00000020:00080000:2.0:1788526771.889065:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98c27b1f6600) has no exports 00010000:00010000:3.0:1788526771.892068:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526771.892083:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1788526771.893727:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c245e7ec60 - data ffff98c27fff4a20/ffff98c2741e6000 00000020:01000000:2.0:1788526771.893893:0:13222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98c2743c8420 - data ffff98c256deda20/ffff98c26ea46000 00010000:00010000:0.0:1788526771.894940:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55c00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:0.0:1788526771.894949:0:5811:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.894964:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788526771.894971:0:5811:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526771.894977:0:5811:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788526771.894980:0:5811:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 10000000:01000000:0.0:1788526771.894983:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788526771.895047:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:0.0:1788526771.895052:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.895059:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242b55c00/0x367645d450b3a1eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a1f2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526771.895073:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526771.895075:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526771.895077:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526771.897231:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c241663600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526771.897245:0:5812:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526771.897260:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526771.897268:0:5812:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526771.897296:0:5812:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788526771.897299:0:5812:0:(mgc_request.c:1180:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788526771.897302:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788526771.897530:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:1.0:1788526771.897536:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.897544:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c241663600/0x367645d450b3a200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b3a207 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526771.897564:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526771.897566:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526771.897569:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788526771.913116:0:13222:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788526771.969183:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a0d3 00000020:00000080:3.0:1788526771.969194:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c27fa75800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788526771.969216:0:13222:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c274ba0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788526771.969220:0:13222:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c274ba0000 3 00000020:01000004:3.0:1788526771.969223:0:13222:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff98c274ba0000 from lustre-OST0001 00000020:00000080:3.0:1788526771.969249:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788526771.969260:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788526771.969263:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c242c2f000/lustre-OST0001_UUID 00000020:00000080:3.0:1788526771.969265:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff98c242c2f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788526771.969280:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788526771.969453:0:13222:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973->MGS 00010000:00010000:3.0:1788526771.969474:0:13222:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c240030a00/0x367645d450b39fd7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526771.969486:0:13222:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c240030a00/0x367645d450b39fd7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526771.969493:0:13222:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788526771.969495:0:13222:0:(mgc_request.c:1197:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788526771.969498:0:13222:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788526771.969522:0:13222:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98c24317f800 00010000:00010000:3.0:1788526771.969525:0:13222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c240030a00/0x367645d450b39fd7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x367645d450b39fde expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788526771.969545:0:13222:0:(import.c:65:import_set_state_nolock()) ffff98c24317f800 MGS: changing import state from DISCONN to CLOSED 10000000:01000000:3.0:1788526771.969550:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788526771.969552:0:13222:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788526771.969565:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788526771.969569:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788526771.969571:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788526771.969574:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788526771.969577:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788526771.969594:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b39ec6 00000020:00000080:3.0:1788526771.969599:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c24317f000/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 00000020:01000000:3.0:1788526771.969605:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.159@tcp (flags='') 00000020:00000080:3.0:1788526771.969610:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788526771.969614:0:13222:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788526771.969618:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98c249711980) has no exports 10000000:01000000:2.0:1788526771.969871:0:5820:0:(mgc_request.c:928:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788526771.970035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27fa75800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788526771.970046:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24317f000/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 for MGC192.168.204.159@tcp 10000000:01000000:3.0:1788526771.970477:0:13222:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.204.159@tcp: client import never connected 00000100:00080000:3.0:1788526771.970481:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788526771.970484:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788526771.970486:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788526771.970488:0:13222:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788526771.970536:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788526771.970542:0:13222:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.159@tcp (uuid 0e25fea5-99a8-4b5c-8bc5-29a9e4b24973) 00000020:01000004:3.0:1788526771.970548:0:13222:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788526771.970551:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788526771.970556:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788526771.970558:0:13222:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788526771.970561:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98c142aa1980) has no exports 00000020:00080000:3.0:1788526771.970566:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98c142aa1980) has no exports 00000020:00000080:0.0:1788526771.970856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c24317f800 for MGC192.168.204.159@tcp 00000020:00000080:0.0:1788526771.970866:0:37:0:(genops.c:885:class_export_put()) final put ffff98c24317c800/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 00000020:00000080:0.0:1788526771.970869:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c24317c800/0e25fea5-99a8-4b5c-8bc5-29a9e4b24973 for MGC192.168.204.159@tcp 00000020:01000000:0.0:1788526771.970875:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.159@tcp (0e25fea5-99a8-4b5c-8bc5-29a9e4b24973) 00000100:00100000:0.0:1788526771.971313:0:12985:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98c24977b400:12985] 0 exiting: rc = 1 00000100:00100000:0.0:1788526771.971414:0:12987:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98c27faa4000:12987] 1 exiting: rc = 0 00000100:00100000:1.0:1788526771.973127:0:12988:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98c27faa5800:12988] 2 exiting: rc = 0 00000100:00100000:3.0:1788526771.973754:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973764:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973771:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973777:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973782:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973787:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973793:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973798:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973803:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973808:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973813:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973832:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973837:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973842:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973847:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973852:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973857:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973863:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973869:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973875:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973882:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973887:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973892:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973897:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973902:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973907:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973912:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973918:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973923:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973928:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973932:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973937:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973943:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973948:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973966:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973972:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973978:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.973993:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974000:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974006:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974011:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974016:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974021:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974027:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974033:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974038:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974051:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974055:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974061:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974067:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974072:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974077:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974083:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974088:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974094:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974100:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974106:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974111:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974117:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974124:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974129:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974135:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974140:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526771.974145:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788526771.974901:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3b1f8 00000020:00000080:3.0:1788526771.974913:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c26e598000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788526771.974928:0:13222:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c274ba0000 from MGS, refs=2 00000020:01000004:3.0:1788526771.974932:0:13222:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c274ba0000 2 00000020:01000004:3.0:1788526771.974935:0:13222:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff98c274ba0000 from MGS 00000020:00000080:3.0:1788526771.974956:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788526771.974963:0:13222:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788526771.974965:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c26e59a000/MGS 00000020:00000080:3.0:1788526771.974968:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e59a000/MGS for MGS 00000020:01000000:3.0:1788526771.974974:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788526771.975040:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788526771.975046:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788526771.975051:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788526771.975057:0:13222:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98c27fa72000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788526771.975064:0:13222:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff98c27b7ab300) has exports, disconnecting them 00000020:00080000:3.0:1788526771.975069:0:13222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98c27fa72000), last request at 1788526543 00000020:00000080:3.0:1788526771.975082:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a0fd 00000020:00080000:3.0:1788526771.975092:0:13222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98c27fa72000): rc 0 00000020:00000080:3.0:1788526771.975096:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c27fa72000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788526771.975772:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c26e598000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788526771.975780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27fa72000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788526771.978157:0:13222:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788526771.978166:0:13222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788526771.978171:0:13222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788526771.978178:0:13222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788526771.978353:0:7617:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1788526771.978506:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98c27b7b1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788526771.978970:0:7618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788526771.979182:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788526771.979321:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788526771.979471:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98c24506b400:5807] 1 exiting: rc = 0 00000100:00100000:0.0:1788526771.979573:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98c247e4ea00:5806] 0 exiting: rc = 1 00000100:00100000:2.0:1788526771.979709:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.979982:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98c25052e200:5808] 0 exiting: rc = 1 00000100:00100000:0.0:1788526771.980236:0:5809:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98c24523b400:5809] 1 exiting: rc = 0 00000100:00100000:0.0:1788526771.980289:0:12910:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98c27b0ed000:12910] 3 exiting: rc = 0 00000100:00100000:1.0:1788526771.980504:0:5810:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98c24523ac00:5810] 2 exiting: rc = 0 00000100:00100000:2.0:1788526771.980734:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980752:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980759:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980765:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980771:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980777:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980784:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980790:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980796:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980803:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980810:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980815:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980821:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980841:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980847:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980852:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980858:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980865:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980871:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980878:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980883:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980889:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980894:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980900:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980905:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980911:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980917:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980922:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980929:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980934:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980940:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.980945:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981071:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981078:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981083:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981088:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981093:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981098:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981103:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981108:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981113:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981118:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981123:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981127:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981132:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981137:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981143:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981147:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981161:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981166:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981171:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981175:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981179:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981184:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981188:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981192:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981197:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981201:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981206:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981210:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981215:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981220:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981224:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526771.981229:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788526771.982632:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788526771.982644:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788526771.982650:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c27b283000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788526771.982654:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27b283000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788526771.982660:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788526771.982708:0:13222:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c274ba0000 1 00000020:00000080:2.0:1788526771.982714:0:13222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x367645d450b3a0a2 00000020:00000080:2.0:1788526771.982721:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c274ba4000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788526771.982749:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788526771.982754:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788526771.982759:0:13222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788526771.982763:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98c249714c80) has no exports 00000020:00000080:0.0:1788526771.982887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98c274ba4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788526772.016545:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526772.016563:0:13222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788526772.016569:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c274ba3800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788526772.016573:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff98c274ba3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788526772.016593:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788526772.016812:0:13222:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff98c274ba6800 00000020:01000000:0.0:1788526772.016834:0:13222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788526772.016838:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788526772.016843:0:13222:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788526772.016848:0:13222:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98c245b3e600) has no exports 00000020:00000080:0.0:1788526772.016871:0:13222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788526772.016879:0:13222:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788526772.016882:0:13222:0:(genops.c:885:class_export_put()) final put ffff98c27453e800/OSS_uuid 00000020:00000080:0.0:1788526772.016885:0:13222:0:(genops.c:844:class_export_destroy()) destroying export ffff98c27453e800/OSS_uuid for OSS 00000020:01000000:0.0:1788526772.016888:0:13222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788526772.016996:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98c242d2f600:6669] 0 exiting: rc = 1 00000100:00100000:0.0:1788526772.017408:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98c242d2ee00:6670] 1 exiting: rc = 0 00000100:00100000:3.0:1788526772.023801:0:12011:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff98c27b79d000:12011] 4 exiting: rc = 0 00000100:00080000:1.0:1788526772.023925:0:5819:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788526772.025908:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98c2453a9e00:6671] 2 exiting: rc = 0 00000100:00100000:2.0:1788526772.027250:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98c2581e6e00:8450] 3 exiting: rc = 0 00000100:00100000:0.0:1788526772.029460:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029473:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029480:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029487:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029493:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029498:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029503:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029509:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029514:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029520:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029525:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029531:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029536:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029542:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029547:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029553:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029747:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029754:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029759:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029765:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029771:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029776:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029780:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029785:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029791:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029797:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029802:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029806:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029812:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029817:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029822:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029827:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029833:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029837:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029843:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029880:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029888:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029892:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029898:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029903:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029909:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029992:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.029998:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030003:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030009:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030075:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030087:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030091:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030095:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030100:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030106:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030121:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030127:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030132:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030138:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030143:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030148:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030152:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030157:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030162:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030167:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030172:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030177:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.030189:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.033734:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98c242d2f400:6673] 1 exiting: rc = 0 00000100:00100000:2.0:1788526772.067650:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98c242d2e600:6672] 0 exiting: rc = 1 00000100:00100000:3.0:1788526772.067753:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067766:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067773:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067779:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067784:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067790:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067795:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067800:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067806:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067811:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067817:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067822:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067827:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067833:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067838:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067844:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067849:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067854:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067860:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067865:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067881:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067887:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067893:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067898:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067904:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067909:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067914:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067919:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067924:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067949:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067955:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067961:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067966:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067971:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067977:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.067994:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068000:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068005:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068010:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068200:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068206:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068211:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068216:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068222:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068227:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068232:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068237:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068241:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068246:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068251:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068256:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068260:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068265:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068270:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068275:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068280:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068285:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068291:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068296:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068302:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068307:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068312:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068318:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.068323:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.069555:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98c249ecaa00:6675] 1 exiting: rc = 0 00000100:00100000:2.0:1788526772.070002:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98c242cd9400:6674] 0 exiting: rc = 1 00000100:00100000:3.0:1788526772.074743:0:12064:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff98c27b78d000:12064] 3 exiting: rc = 0 00000100:00100000:3.0:1788526772.075832:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98c249eca400:6676] 2 exiting: rc = 0 00000100:00100000:3.0:1788526772.075925:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075932:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075938:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075943:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075948:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075956:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075961:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075970:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075976:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.075994:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076000:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076011:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076865:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076893:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076900:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076906:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076912:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076919:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076924:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076930:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076936:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076945:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076952:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076958:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076964:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076970:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076977:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.076995:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077001:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077007:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077087:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077109:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077115:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077120:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077127:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077132:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077137:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077157:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077164:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077169:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077175:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077180:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077186:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077191:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077196:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077201:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077207:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077212:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077217:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077222:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077236:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077243:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077248:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077254:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077260:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077267:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077273:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077278:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077283:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077288:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077293:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077299:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077304:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.077310:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788526772.095851:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98c27b2dec00:6678] 1 exiting: rc = 0 00000100:00100000:0.0:1788526772.095851:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98c249ed4c00:6677] 0 exiting: rc = 1 00000100:00100000:2.0:1788526772.096100:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096121:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096127:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096132:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096137:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096142:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096147:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096153:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096157:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096162:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096166:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096171:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096195:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096201:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096207:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096223:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096229:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096234:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096239:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096243:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096248:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096254:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096258:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096262:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096267:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096272:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096276:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096284:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096297:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096303:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096308:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096314:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096319:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096324:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096330:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096335:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096348:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096353:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096358:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096362:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096366:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096371:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096375:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096380:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096415:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096422:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096428:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096433:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096438:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096445:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096449:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096455:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096461:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096466:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096471:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096478:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096483:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096488:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096494:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096500:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096505:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096509:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096515:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.096521:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788526772.098335:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98c27b0ec400:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1788526772.106266:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98c27b2ed000:6679] 0 exiting: rc = 1 00000100:00100000:0.0:1788526772.106421:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106432:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106437:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106445:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106451:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106457:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106463:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106469:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106476:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106482:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106489:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106495:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106516:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106524:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106530:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106536:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106543:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106549:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106555:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106561:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106566:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106580:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106601:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106608:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106702:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106709:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106715:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106721:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106726:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106732:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106807:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106814:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106820:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106826:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106831:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106836:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106860:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106866:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106872:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106880:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106886:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106892:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106898:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106907:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106913:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106919:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106925:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.106931:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108256:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108271:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108277:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108283:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108290:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108296:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108301:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108307:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108323:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108329:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108334:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108340:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108358:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108366:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108372:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788526772.108378:0:13222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788526772.163340:0:13222:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788526790.943799:0:13836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788526802.481696:0:14298:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788526802.481704:0:14298:0:(obd_mount.c:928:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788526802.481813:0:14298:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c244e62800 00000020:01000004:3.0:1788526802.481831:0:14298:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788526802.481840:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788526802.481857:0:14298:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98c27b7a8000) 00000020:00000080:3.0:1788526802.481871:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788526802.512207:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788526802.515978:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788526802.518122:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 209: rc = 0 00100000:10000000:0.0:1788526802.518230:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 209: rc = 0 00100000:10000000:0.0:1788526802.518325:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 209: rc = 0 00100000:10000000:0.0:1788526802.519193:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:0.0:1788526802.519373:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 209: rc = 0 00100000:10000000:0.0:1788526802.519983:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788526802.520873:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 209: rc = 0 00100000:10000000:0.0:1788526802.521620:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 56: rc = 0 00100000:10000000:0.0:1788526802.525325:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 212: rc = 0 00100000:10000000:0.0:1788526802.525614:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 212: rc = 0 00100000:10000000:0.0:1788526802.526061:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 215: rc = 0 00100000:10000000:0.0:1788526802.526302:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 215: rc = 0 00100000:10000000:0.0:1788526802.526717:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.526976:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.527252:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.527569:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 215: rc = 0 00100000:10000000:0.0:1788526802.527841:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.528085:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 215: rc = 0 00100000:10000000:0.0:1788526802.530024:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.530284:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 215: rc = 0 00100000:10000000:0.0:1788526802.530546:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 215: rc = 0 00100000:10000000:0.0:1788526802.530780:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 215: rc = 0 00100000:10000000:0.0:1788526802.531170:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 599: rc = 0 00100000:10000000:0.0:1788526802.531488:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 599: rc = 0 00100000:10000000:0.0:1788526802.531725:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 599: rc = 0 00100000:10000000:0.0:1788526802.531953:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 599: rc = 0 00100000:10000000:0.0:1788526802.532191:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 599: rc = 0 00100000:10000000:0.0:1788526802.532475:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 599: rc = 0 00100000:10000000:0.0:1788526802.534606:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 599: rc = 0 00100000:10000000:0.0:1788526802.535005:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 599: rc = 0 00100000:10000000:0.0:1788526802.535252:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 599: rc = 0 00100000:10000000:0.0:1788526802.535602:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 599: rc = 0 00100000:10000000:2.0:1788526802.541627:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 599: rc = 0 00100000:10000000:2.0:1788526802.542243:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 599: rc = 0 00100000:10000000:2.0:1788526802.542540:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 599: rc = 0 00100000:10000000:2.0:1788526802.542965:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 599: rc = 0 00100000:10000000:2.0:1788526802.543230:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 599: rc = 0 00100000:10000000:2.0:1788526802.545114:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 599: rc = 0 00100000:10000000:2.0:1788526802.545423:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 599: rc = 0 00100000:10000000:2.0:1788526802.546926:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 599: rc = 0 00100000:10000000:2.0:1788526802.547303:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 599: rc = 0 00100000:10000000:2.0:1788526802.547608:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 599: rc = 0 00100000:10000000:2.0:1788526802.549325:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 599: rc = 0 00100000:10000000:2.0:1788526802.551130:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 599: rc = 0 00100000:10000000:2.0:1788526802.551457:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 599: rc = 0 00100000:10000000:2.0:1788526802.551732:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 599: rc = 0 00100000:10000000:2.0:1788526802.551993:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 599: rc = 0 00100000:10000000:2.0:1788526802.554907:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 599: rc = 0 00100000:10000000:2.0:1788526802.555198:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 599: rc = 0 00100000:10000000:3.0:1788526802.556553:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 599: rc = 0 00100000:10000000:3.0:1788526802.556810:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 599: rc = 0 00100000:10000000:3.0:1788526802.557345:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 599: rc = 0 00100000:10000000:3.0:1788526802.557821:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 599: rc = 0 00100000:10000000:3.0:1788526802.558044:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 599: rc = 0 00100000:10000000:3.0:1788526802.558378:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 588: rc = 0 00100000:10000000:3.0:1788526802.559166:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788526802.559313:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 213: rc = 0 00100000:10000000:3.0:1788526802.559589:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788526802.559652:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 213: rc = 0 00100000:10000000:3.0:1788526802.559999:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788526802.560067:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 213: rc = 0 00100000:10000000:3.0:1788526802.560383:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788526802.560503:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 585: rc = 0 00100000:10000000:3.0:1788526802.560859:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788526802.560927:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 585: rc = 0 00100000:10000000:3.0:1788526802.561286:0:14298:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788526802.561345:0:14298:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 585: rc = 0 00000020:00000080:3.0:1788526802.561930:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788526802.561940:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788526802.561950:0:14298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b206 00000020:01000004:3.0:1788526802.561958:0:14298:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788526802.561973:0:14298:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788526802.561977:0:14298:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c244e62800 from MGS 00000020:01000004:3.0:1788526802.561981:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788526802.561990:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98c27b7acc80) 00000020:00000080:3.0:1788526802.561999:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788526802.562053:0:14298:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c244e62800 from MGS, refs=2 00080000:01000000:3.0:1788526802.562058:0:14298:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788526802.562062:0:14298:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b214 00000100:00100000:3.0:1788526802.562151:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788526802.562272:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788526802.562278:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788526802.563226:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788526802.563234:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788526802.563748:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.563906:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788526802.563915:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788526802.564526:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788526802.564533:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788526802.564830:0:14298:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788526802.564835:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788526802.565436:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526802.565438:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526802.565440:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526802.565766:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526802.565768:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526802.565770:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526802.566203:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788526802.571614:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788526802.576102:0:14298:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788526802.576123:0:14298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788526802.576126:0:14298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788526802.577435:0:14307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788526802.577583:0:14298:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788526802.577676:0:14298:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788526802.578106:0:14298:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788526802.578721:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526802.578877:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788526802.578882:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788526802.583852:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788526802.583866:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788526802.584215:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788526802.584221:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788526802.584980:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788526802.585004:0:14298:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:0.0:1788526802.585006:0:14298:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788526802.585040:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:0.0:1788526802.585053:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (ffff98c24967cc80) 00000020:00000080:0.0:1788526802.585070:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788526802.585143:0:14298:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c143200000@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1788526802.585291:0:14298:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:0.0:1788526802.585297:0:14298:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788526802.585708:0:14312:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788526802.585925:0:14313:0:(mgc_request.c:839:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788526802.585997:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid a25a41ce-5827-423c-b0c5-e955955f4e9e) 00000020:00000080:1.0:1788526802.586017:0:14298:0:(genops.c:1385:class_connect()) connect: client a25a41ce-5827-423c-b0c5-e955955f4e9e, cookie 0x367645d450b3b222 00000100:00080000:1.0:1788526802.586028:0:14298:0:(import.c:545:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788526802.586033:0:14298:0:(import.c:665:import_select_connection()) MGC192.168.204.159@tcp: import ffff98c143200000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526802.586134:0:14298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274963800 x1875405881570048/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788526802.586190:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25a41ce-5827-423c-b0c5-e955955f4e9e:3277:1875405881570048:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788526802.586254:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526802.586342:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570048 00000100:00100000:2.0:1788526802.586349:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570048 00000100:00100000:2.0:1788526802.586426:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526802.586434:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3277:x1875405881570048:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788526802.586467:0:14308:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from a25a41ce-5827-423c-b0c5-e955955f4e9e@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1788526802.586490:0:14308:0:(genops.c:1385:class_connect()) connect: client a25a41ce-5827-423c-b0c5-e955955f4e9e, cookie 0x367645d450b3b229 00000100:00080000:2.0:1788526802.586600:0:14308:0:(import.c:65:import_set_state_nolock()) ffff98c274b3d000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788526802.586807:0:14298:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a25a41ce-5827-423c-b0c5-e955955f4e9e->MGS 00000020:01000004:1.0:1788526802.586825:0:14298:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788526802.586831:0:14298:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788526802.586842:0:14298:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98c142aa6600) 00000020:00000080:1.0:1788526802.586852:0:14298:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788526802.589349:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:3277:x1875405881570048:12345-0@lo:250:mount.lustre.0 Request processed in 2904us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.589364:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526802.592775:0:3277:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788526802.592801:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:0.0:1788526802.592811:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788526802.592817:0:3277:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788526802.592822:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c143200000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788526802.592825:0:3277:0:(mgc_request.c:1414:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788526802.592833:0:3277:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788526802.592843:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25a41ce-5827-423c-b0c5-e955955f4e9e:3277:1875405881570048:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788526802.596159:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.596350:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788526802.596503:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788526802.601640:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788526802.601661:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788526802.610843:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788526802.610856:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788526802.611940:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.612112:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788526802.612117:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788526802.612844:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788526802.612852:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788526802.676346:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526802.676604:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788526802.676611:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788526802.679004:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788526802.679023:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788526802.679912:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.680166:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526802.680171:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788526802.681333:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526802.681343:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788526802.682002:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.682359:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526802.682363:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788526802.683203:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526802.683211:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788526802.684260:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.684797:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788526802.684805:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788526802.685752:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788526802.685761:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788526802.706024:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526802.706283:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788526802.706288:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788526802.708787:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788526802.708803:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788526802.710004:0:14298:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788526802.710015:0:14298:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788526802.711899:0:14298:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788526802.711947:0:14298:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788526802.711952:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788526802.711954:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788526802.711955:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526802.711956:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526802.711958:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526802.711959:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526802.711961:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788526802.711962:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788526802.711965:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526802.711966:0:14298:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526802.711971:0:14298:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788526802.711978:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788526802.711979:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788526802.711980:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526802.711981:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526802.711982:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526802.711983:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526802.711984:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788526802.711985:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788526802.711986:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526802.711987:0:14298:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526802.712017:0:14298:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788526802.712110:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788526802.712207:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.712291:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c260616b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.712343:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570176 00000100:00100000:2.0:1788526802.712810:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570176 00000100:00100000:2.0:1788526802.712892:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526802.712911:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:14298:x1875405881570176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788526802.712961:0:14311:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788526802.712964:0:14311:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788526802.712967:0:14311:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788526802.713322:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788526802.714015:0:14311:0:(mgs_nids.c:671:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788526802.716291:0:14333:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788526802.716301:0:14333:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788526802.716304:0:14333:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788526802.716338:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788526802.718232:0:14311:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788526802.718251:0:14311:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788526802.725314:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:14298:x1875405881570176:12345-0@lo:253:mount.lustre.0 Request processed in 12396us (13098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.725336:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526802.725615:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570176:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788526802.725631:0:14298:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788526802.725634:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788526802.725636:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788526802.725637:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526802.725638:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526802.725640:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526802.725641:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526802.725643:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788526802.725644:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788526802.725646:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526802.725648:0:14298:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788526802.725735:0:14298:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c244e62800 from lustre-MDT0000 10000000:01000000:1.0:1788526802.725761:0:14298:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788526802.725764:0:14298:0:(mgc_request.c:423:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788526802.725768:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c244e62800 10000000:01000000:1.0:1788526802.725776:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526802.725795:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c244e62800 from 1 10000000:01000000:1.0:1788526802.725799:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788526802.725833:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.725860:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.725871:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.725889:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526802.725928:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.726009:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.726103:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570304 00000100:00100000:2.0:1788526802.726109:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570304 00000100:00100000:2.0:1788526802.726178:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526802.726187:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:14298:x1875405881570304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526802.726198:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526802.726211:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c77800/0x367645d450b3b23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b237 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.726232:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c77800/0x367645d450b3b23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b237 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.726242:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c77800/0x367645d450b3b23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b237 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.726251:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77800, rc 0) 00000100:00100000:2.0:1788526802.726286:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+6:14298:x1875405881570304:12345-0@lo:101:mount.lustre.0 Request processed in 101us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.726292:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526802.726346:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788526802.726367:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b23e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.726376:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b23e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.726438:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526802.726463:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.730101:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.730279:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570432 00000100:00100000:3.0:1788526802.730290:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570432 00000100:00100000:3.0:1788526802.730338:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788526802.730348:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+6:14298:x1875405881570432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526802.730787:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+6:14298:x1875405881570432:12345-0@lo:501:mount.lustre.0 Request processed in 440us (4322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788526802.730795:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526802.730917:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570432:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788526802.730939:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788526802.730956:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b23e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.730967:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245110600/0x367645d450b3b237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b23e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526802.730990:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c244e62800 10000000:01000000:1.0:1788526802.730996:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788526802.731017:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff98c244e62800 10000000:01000000:1.0:1788526802.731021:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788526802.731042:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-barrier-ffff98c244e62800 from 1 10000000:01000000:1.0:1788526802.731046:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788526802.731079:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731088:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731098:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.731116:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526802.731150:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.731180:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.731290:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570560 00000100:00100000:3.0:1788526802.731295:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570560 00000100:00100000:3.0:1788526802.731316:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526802.731323:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+6:14298:x1875405881570560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526802.731333:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526802.731347:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7000/0x367645d450b3b24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b245 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.731384:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7000/0x367645d450b3b24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b245 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.731431:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7000/0x367645d450b3b24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b245 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.731441:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7000, rc 0) 00000100:00100000:3.0:1788526802.731593:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+7:14298:x1875405881570560:12345-0@lo:101:mount.lustre.0 Request processed in 270us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.731600:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788526802.731697:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788526802.731711:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b24c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731721:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b24c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526802.731733:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788526802.731738:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b24c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731752:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245110e00/0x367645d450b3b245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b24c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526802.731759:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788526802.731764:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526802.731779:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff98c244e62800 10000000:01000000:1.0:1788526802.731783:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788526802.731794:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788526802.731797:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788526802.731813:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731821:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.731828:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.731842:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526802.731873:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.731904:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.732009:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570688 00000100:00100000:3.0:1788526802.732013:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570688 00000100:00100000:3.0:1788526802.732046:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526802.732054:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+7:14298:x1875405881570688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526802.732061:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526802.732071:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7800/0x367645d450b3b25a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b253 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.732086:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7800/0x367645d450b3b25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b253 expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.732095:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7800/0x367645d450b3b25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b253 expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.732101:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7800, rc 0) 00000100:00100000:3.0:1788526802.732135:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+8:14298:x1875405881570688:12345-0@lo:101:mount.lustre.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.732140:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526802.732264:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788526802.732275:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b25a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.732282:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b25a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.732322:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526802.732348:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.732465:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.732565:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570816 00000100:00100000:3.0:1788526802.732569:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570816 00000100:00100000:3.0:1788526802.732588:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526802.732593:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+8:14298:x1875405881570816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526802.732946:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14298:x1875405881570816:12345-0@lo:501:mount.lustre.0 Request processed in 351us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.732954:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788526802.733123:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526802.733154:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788526802.733194:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.733226:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.733305:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881570944 00000100:00100000:2.0:1788526802.733311:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881570944 00000100:00100000:2.0:1788526802.733334:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788526802.733340:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14298:x1875405881570944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526802.733874:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14298:x1875405881570944:12345-0@lo:503:mount.lustre.0 Request processed in 532us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.733890:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788526802.733986:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881570944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788526802.734639:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14334:1875405881571072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788526802.734688:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.734722:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c260616780 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.734771:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571072 00000100:00100000:2.0:1788526802.734776:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571072 00000100:00100000:2.0:1788526802.734836:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526802.734844:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14334:x1875405881571072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526802.735104:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14334:x1875405881571072:12345-0@lo:502:llog_process_th.0 Request processed in 260us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.735111:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788526802.735176:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14334:1875405881571072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788526802.735200:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526802.735210:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526802.735212:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788526802.735218:0:14334:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788526802.735221:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788526802.735235:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98c142aa3300) 00000020:00000080:1.0:1788526802.735250:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788526802.735254:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788526802.735312:0:14334:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788526802.735317:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b268 00000020:00000080:1.0:1788526802.735837:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788526802.735843:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526802.735846:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526802.735856:0:14334:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788526802.735859:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526802.735862:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526802.735864:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788526802.735867:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788526802.735875:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98c142aa0000) 00000020:00000080:1.0:1788526802.735885:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788526802.735888:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788526802.735890:0:14334:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788526802.735893:0:14334:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788526802.735899:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788526802.735946:0:14334:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c244e62800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788526802.735959:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98c142aa1980) 00000020:00000080:1.0:1788526802.735966:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788526802.736010:0:14334:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788526802.736016:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3b27d 00000020:00000080:1.0:1788526802.736120:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788526802.736127:0:14334:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788526802.736132:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x367645d450b3b284 00080000:01000000:1.0:1788526802.736137:0:14334:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788526802.736141:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b28b 00010000:00010000:3.0:1788526802.860584:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788526802.862232:0:14334:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788526802.862867:0:14334:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788526802.863858:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98c27b1f1980) 00000020:00000080:2.0:1788526802.863884:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788526802.863957:0:14334:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788526802.863964:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b299 00000020:00000080:2.0:1788526802.874415:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788526802.903202:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x367645d450b3b2a0 00000020:00000080:2.0:1788526802.905197:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788526802.905212:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526802.905221:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526802.905224:0:14334:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788526802.905228:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788526802.905235:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526802.905236:0:14334:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788526802.905241:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788526802.905291:0:14334:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788526802.905307:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788526802.905311:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526802.905312:0:14334:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788526802.905315:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788526802.905331:0:14334:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788526802.905333:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788526802.905335:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788526802.905337:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788526802.905340:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526802.905342:0:14334:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788526802.905344:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788526802.905348:0:14334:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788526802.905351:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788526802.905352:0:14334:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788526802.905355:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788526802.905362:0:14334:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:2.0:1788526802.905421:0:14334:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788526802.905424:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788526802.905442:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98c27b1f0000) 00000020:00000080:2.0:1788526802.905458:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788526802.905463:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788526802.908567:0:14334:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788526802.908580:0:14334:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788526802.908592:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b2ae 00010000:00080000:0.0:1788526802.908647:0:14334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c24823a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1788526802.908896:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788526802.910459:0:14334:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788526802.910506:0:14334:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788526802.913004:0:14334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526802.913968:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788526802.915191:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788526802.918370:0:14338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788526802.918379:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788526802.923624:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788526802.923656:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788526802.923700:0:14334:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788526802.923725:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3b2b5 00000100:00080000:0.0:1788526802.923740:0:14334:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788526802.923749:0:14334:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c24823a000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526802.923796:0:14334:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e0700 x1875405881571200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788526802.923855:0:14334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788526802.923920:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526802.923924:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.923926:0:14334:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788526802.923929:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788526802.923932:0:14334:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788526802.923933:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788526802.923935:0:14334:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788526802.923936:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788526802.923939:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.923940:0:14334:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788526802.923942:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788526802.923946:0:14334:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788526802.923949:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.923951:0:14334:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788526802.923954:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788526802.923958:0:14334:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:0.0:1788526802.923982:0:14334:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788526802.923985:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788526802.923999:0:14334:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98c24967e600) 00000020:00000080:0.0:1788526802.924013:0:14334:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788526802.924017:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788526802.924203:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881571200:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788526802.924257:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875405881571200 offset 0 length 520: 4 00000004:00080000:0.0:1788526802.924577:0:14334:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788526802.924584:0:14334:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788526802.924592:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x367645d450b3b2c3 00010000:00080000:0.0:1788526802.924623:0:14334:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27f588000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1788526802.925799:0:14334:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788526802.926012:0:14334:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788526802.926312:0:14334:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788526802.929871:0:14334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526802.929995:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788526802.930196:0:14334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788526802.931700:0:14340:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788526802.931707:0:14340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788526802.932617:0:14334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788526802.932637:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788526802.932766:0:14334:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788526802.932788:0:14334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3b2ca 00000100:00080000:0.0:1788526802.932801:0:14334:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788526802.932807:0:14334:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526802.932847:0:14334:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e3b80 x1875405881571328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526802.932905:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881571328:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788526802.932961:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875405881571328 offset 0 length 520: 4 00000100:00080000:0.0:1788526802.933016:0:14334:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788526802.933074:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526802.933078:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.933080:0:14334:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788526802.933083:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526802.933086:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.933087:0:14334:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788526802.933090:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788526802.933091:0:14334:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788526802.933094:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526802.933096:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.933097:0:14334:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788526802.933099:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526802.933102:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.933103:0:14334:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788526802.933106:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788526802.933132:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14334:1875405881571456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788526802.933179:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526802.933196:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c248298240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.933476:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571456 00000100:00100000:3.0:1788526802.933483:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571456 00000100:00100000:3.0:1788526802.933524:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788526802.933541:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14334:x1875405881571456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526802.933795:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14334:x1875405881571456:12345-0@lo:502:llog_process_th.0 Request processed in 255us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.933804:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788526802.934178:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14334:1875405881571456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788526802.934208:0:14334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526802.934219:0:14334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526802.934221:0:14334:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788526802.934225:0:14334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788526802.935435:0:14298:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788526802.935455:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788526802.935482:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b25a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.935494:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245111800/0x367645d450b3b253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b25a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526802.935502:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c244e62800 from 1 10000000:01000000:3.0:1788526802.935505:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788526802.935551:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.935559:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.935568:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526802.935589:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788526802.935659:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.935711:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.935986:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571584 00000100:00100000:2.0:1788526802.935995:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571584 00000100:00100000:2.0:1788526802.936051:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788526802.936060:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+9:14298:x1875405881571584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526802.936075:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526802.936093:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b2d1 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.936117:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 10 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.936149:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 10 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.936157:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c77600, rc 0) 00000100:00100000:2.0:1788526802.936195:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+10:14298:x1875405881571584:12345-0@lo:101:mount.lustre.0 Request processed in 136us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.936201:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526802.936579:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526802.936597:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.936615:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526802.937334:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788526802.937437:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526802.937579:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571712 00000100:00100000:2.0:1788526802.937585:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571712 00000100:00100000:2.0:1788526802.937622:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526802.937644:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+10:14298:x1875405881571712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788526802.937666:0:14308:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788526802.937684:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788526802.937763:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+10:14298:x1875405881571712:12345-0@lo:256:mount.lustre.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.937771:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788526802.938109:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.938131:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571712:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788526802.939229:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788526802.939295:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.939308:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526802.939317:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c244e62800 from 1 10000000:01000000:3.0:1788526802.939320:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526802.939360:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.939370:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.939380:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526802.939435:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788526802.939507:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.939562:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.941657:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571840 00000100:00100000:2.0:1788526802.941683:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571840 00000100:00100000:2.0:1788526802.941752:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526802.941761:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+10:14298:x1875405881571840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526802.941778:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526802.941799:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b2df expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.941829:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b2df expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.941863:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b2df expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.941872:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76400, rc 0) 00000100:00100000:2.0:1788526802.941966:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881571840:12345-0@lo:101:mount.lustre.0 Request processed in 205us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.941973:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526802.942227:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526802.942249:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.942259:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526802.942313:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526802.942346:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.942411:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526802.942625:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881571968 00000100:00100000:1.0:1788526802.942640:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881571968 00000100:00100000:1.0:1788526802.942685:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788526802.942692:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881571968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526802.943263:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881571968:12345-0@lo:501:mount.lustre.0 Request processed in 569us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526802.943278:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788526802.943429:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881571968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526802.943477:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788526802.943517:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.943548:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.943845:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572096 00000100:00100000:2.0:1788526802.943852:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572096 00000100:00100000:2.0:1788526802.943886:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526802.943895:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881572096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526802.944080:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881572096:12345-0@lo:503:mount.lustre.0 Request processed in 186us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.944087:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526802.944287:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788526802.946736:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14342:1875405881572224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526802.946822:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.946873:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.947001:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572224 00000100:00100000:2.0:1788526802.947008:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572224 00000100:00100000:2.0:1788526802.947070:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526802.947079:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14342:x1875405881572224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526802.947420:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14342:x1875405881572224:12345-0@lo:502:llog_process_th.0 Request processed in 304us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.947430:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788526802.947778:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14342:1875405881572224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526802.947812:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526802.947821:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.947824:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788526802.947831:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c244e62800 00000020:00000080:3.0:1788526802.947834:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526802.947843:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526802.947852:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.947853:0:14342:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788526802.947856:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526802.947859:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.947860:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788526802.947864:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c244e62800 00000020:00000080:3.0:1788526802.947866:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526802.947921:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526802.947925:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.947926:0:14342:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788526802.947929:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526802.947930:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.947932:0:14342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788526802.947936:0:14342:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c244e62800 00000020:00000080:3.0:1788526802.947938:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788526802.947975:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14342:1875405881572352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526802.948016:0:14342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526802.948563:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526802.948630:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572352 00000100:00100000:1.0:1788526802.948637:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572352 00000100:00100000:1.0:1788526802.948694:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788526802.948702:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14342:x1875405881572352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788526802.948890:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14342:x1875405881572352:12345-0@lo:502:llog_process_th.0 Request processed in 188us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526802.948897:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788526802.949254:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14342:1875405881572352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788526802.949281:0:14342:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526802.949287:0:14342:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526802.949288:0:14342:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788526802.949292:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788526802.951708:0:14298:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788526802.951724:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526802.951742:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.951754:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526802.951816:0:14298:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788526802.951819:0:14298:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c244e62800 10000000:01000000:1.0:1788526802.951823:0:14298:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c244e62800 10000000:01000000:1.0:1788526802.951828:0:14298:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526802.951849:0:14298:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c244e62800 from 1 10000000:01000000:1.0:1788526802.951852:0:14298:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526802.951895:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.951905:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526802.951916:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526802.951950:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526802.952020:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526802.952073:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c260616780 going to sleep for 11 seconds 00000100:00100000:3.0:1788526802.954867:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572480 00000100:00100000:3.0:1788526802.954884:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572480 00000100:00100000:3.0:1788526802.954949:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526802.954960:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881572480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526802.954978:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526802.954997:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7a00/0x367645d450b3b2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b2ed expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.955056:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7a00/0x367645d450b3b2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b2ed expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.955068:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7a00/0x367645d450b3b2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b2ed expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526802.955077:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7a00, rc 0) 00000100:00100000:3.0:1788526802.955167:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881572480:12345-0@lo:101:mount.lustre.0 Request processed in 208us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526802.955175:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788526802.958856:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526802.958891:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2f4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526802.958920:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b2f4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526802.958989:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526802.959065:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526802.959106:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250817cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526802.960171:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572608 00000100:00100000:2.0:1788526802.960186:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572608 00000100:00100000:2.0:1788526802.960253:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788526802.960266:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881572608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526802.961590:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881572608:12345-0@lo:501:mount.lustre.0 Request processed in 1319us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526802.961603:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788526802.962645:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526802.962876:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526802.962953:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526802.962995:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250817cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526802.966156:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572736 00000100:00100000:1.0:1788526802.966172:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572736 00000100:00100000:1.0:1788526802.966240:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526802.966251:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881572736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788526802.969295:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881572736:12345-0@lo:503:mount.lustre.0 Request processed in 3037us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526802.969309:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788526802.979535:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881572736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788526803.012801:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14346:1875405881572864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526803.012927:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526803.012973:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572864 00000100:00100000:3.0:1788526803.012980:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572864 00000100:00100000:3.0:1788526803.013228:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788526803.013240:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14346:x1875405881572864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788526803.013614:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14346:x1875405881572864:12345-0@lo:502:llog_process_th.0 Request processed in 377us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526803.013622:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788526803.013819:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27238b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526803.013844:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14346:1875405881572864:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788526803.013912:0:14346:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788526803.013930:0:14346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98c27b7a9980) 00000020:00000080:3.0:1788526803.013949:0:14346:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788526803.015968:0:14346:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c244e62800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788526803.015978:0:14346:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c244e62800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788526803.015993:0:14346:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c244e62800 4 00010000:00080000:3.0:1788526803.016547:0:14346:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c2741cb000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1788526803.023209:0:14346:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788526803.023952:0:14346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788526803.023995:0:14346:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788526803.024010:0:14346:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x367645d450b3b302 00000100:00080000:3.0:1788526803.024022:0:14346:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788526803.024105:0:14346:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98c2741cb000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526803.024151:0:14346:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274779180 x1875405881572992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788526803.024180:0:14346:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788526803.031480:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881572992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788526803.031568:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526803.031801:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881572992 00000100:00100000:2.0:1788526803.031810:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881572992 00000100:00100000:2.0:1788526803.031852:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526803.031859:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875405881572992:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788526803.031920:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3277:x1875405881572992:12345-0@lo:38:llog_process_th.0 Request processed in 58us (350us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788526803.031938:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526803.032004:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788526803.032012:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c2741cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526803.032016:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788526803.032019:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881572992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788526803.032856:0:14346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14346:1875405881573120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788526803.032920:0:14346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526803.032954:0:14346:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2508176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526803.033030:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573120 00000100:00100000:0.0:1788526803.033037:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573120 00000100:00100000:0.0:1788526803.033081:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788526803.033088:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14346:x1875405881573120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788526803.033326:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14346:x1875405881573120:12345-0@lo:502:llog_process_th.0 Request processed in 238us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526803.033334:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788526803.035618:0:14346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25a41ce-5827-423c-b0c5-e955955f4e9e:14346:1875405881573120:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788526803.035819:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788526803.035957:0:14298:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788526803.035968:0:14298:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788526803.035996:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2f4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.036008:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245110000/0x367645d450b3b2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b2f4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788526803.036084:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788526803.036087:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788526803.036088:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788526803.036089:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788526803.036091:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788526803.036092:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788526803.036094:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788526803.036095:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788526803.036097:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788526803.036098:0:14298:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788526803.036102:0:14298:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788526803.036105:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788526803.036106:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788526803.036114:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788526803.036114:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788526803.036115:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788526803.036116:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788526803.036117:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788526803.036118:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788526803.036119:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788526803.036120:0:14298:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788526803.036156:0:14298:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788526803.036173:0:14298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881573248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788526803.036236:0:14298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526803.036277:0:14298:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27238b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788526803.036501:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573248 00000100:00100000:2.0:1788526803.036508:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573248 00000100:00100000:2.0:1788526803.036549:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788526803.036558:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14298:x1875405881573248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788526803.036585:0:14311:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788526803.036600:0:14311:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788526803.173499:0:14311:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788526803.173513:0:14311:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788526803.174500:0:14332:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788526803.174507:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788526803.174533:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.174554:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.174564:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.174609:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.174641:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 12 pid: 14311 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526803.174661:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881573376:0@lo:104: 00000100:00100000:0.0:1788526803.174759:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526803.174816:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247f0ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526803.175695:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573376 00000100:00100000:1.0:1788526803.175707:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573376 00000100:00100000:1.0:1788526803.175762:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526803.175773:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881573376:12345-0@lo:104: 00010000:00010000:1.0:1788526803.175788:0:14299:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526803.176547:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788526803.176555:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881573376:12345-0@lo:104: Request processed in 784us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526803.176564:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788526803.176663:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526803.176681:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.176691:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526803.176696:0:14305:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.176705:0:14305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526803.176712:0:14305:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526803.176719:0:14305:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788526803.176763:0:14305:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.176770:0:14305:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526803.176795:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.176819:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b2d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2d8 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.176836:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526803.176838:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526803.176840:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526803.176888:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881573504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788526803.179567:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881573376:0@lo:104: 00010000:00010000:0.0:1788526803.179600:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526803.180753:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526803.183703:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573504 00000100:00100000:2.0:1788526803.183718:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573504 00010000:00010000:2.0:1788526803.183756:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 13 pid: 14311 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526803.183816:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526803.183825:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:3279:x1875405881573504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526803.183840:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526803.183845:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 13 pid: 14311 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183857:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 13 pid: 14311 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183886:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242c77600/0x367645d450b3b2d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b2d1 expref: 13 pid: 14311 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183902:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183911:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788526803.183926:0:14301:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009419535s 00010000:00010000:2.0:1788526803.183930:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183938:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183945:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183951:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183957:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526803.183962:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183970:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.183984:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526803.184014:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526803.184096:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3279:x1875405881573504:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526803.184104:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788526803.186587:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.186606:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.186614:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821a00/0x367645d450b3b309 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526803.190234:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881573504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788526803.207691:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14298:x1875405881573248:12345-0@lo:253:mount.lustre.0 Request processed in 171121us (171442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526803.207709:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788526803.209736:0:14298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14298:1875405881573248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788526803.209759:0:14298:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788526803.209762:0:14298:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788526803.209763:0:14298:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788526803.209765:0:14298:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788526803.209766:0:14298:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788526803.209767:0:14298:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788526803.209768:0:14298:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788526803.209770:0:14298:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788526803.209771:0:14298:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788526803.209773:0:14298:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788526803.209774:0:14298:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788526803.209793:0:14298:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788526803.224922:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.226713:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526803.227164:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.227320:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526803.228329:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.228669:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526803.233726:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.233900:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526803.234869:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.240841:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526803.241177:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526803.241315:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788526803.302738:0:14298:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788526803.303261:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788526803.303908:0:14354:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788526803.303912:0:14354:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788526803.305316:0:14355:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788526803.305472:0:14355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788526803.307932:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788526803.308045:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788526803.308564:0:14298:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788526803.308571:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788526803.308695:0:14298:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526803.314294:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788526803.316553:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788526803.316628:0:14298:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788526803.319689:0:14355:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788526803.319765:0:14355:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788526803.319770:0:14355:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:0.0:1788526803.328367:0:14298:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788526803.340362:0:14298:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788526803.382510:0:14298:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788526803.382551:0:14298:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaec7018cf9b8 00100000:10000000:2.0:1788526803.382559:0:14298:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788526803.383983:0:14298:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788526803.384004:0:14298:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788526803.605865:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788526803.732148:0:14313:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788526803.732160:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c244e62800 from 6 10000000:01000000:0.0:1788526803.732166:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788526803.732241:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.732256:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.732271:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526803.732304:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881573632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788526803.732427:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526803.732499:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2480b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526803.732748:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573632 00000100:00100000:3.0:1788526803.732768:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573632 00000100:00100000:3.0:1788526803.732836:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788526803.732848:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14313:x1875405881573632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526803.732864:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526803.732882:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b310 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.732911:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b310 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.732938:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b310 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526803.732949:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6400, rc 0) 00000100:00100000:3.0:1788526803.733005:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881573632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526803.733024:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788526803.733701:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881573632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526803.733725:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.733737:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526803.733823:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881573760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788526803.733889:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526803.733930:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2480b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526803.734308:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573760 00000100:00100000:3.0:1788526803.734315:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573760 00000100:00100000:3.0:1788526803.734364:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788526803.734403:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881573760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788526803.734426:0:14311:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788526803.734446:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788526803.734450:0:14311:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788526803.735268:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881573760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 883us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526803.735277:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788526803.735449:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881573760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788526803.735685:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788526803.735696:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526803.735708:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526804.052759:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788526804.628296:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788526805.076083:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788526805.653127:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526806.676545:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526807.704613:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788526808.531532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788526808.531539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788526808.531541:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788526808.531544:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788526808.531555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788526808.531558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788526808.531562:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c2741cb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788526808.531575:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98c2741cb000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1788526808.531599:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27477b800 x1875405881574016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526808.531652:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788526808.531666:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881573888:0@lo:400:kworker.0 00000100:00100000:3.0:1788526808.531741:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526808.531799:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881574016:0@lo:38:kworker.0 00000100:00100000:3.0:1788526808.531848:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526808.531891:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881573888 00000100:00100000:3.0:1788526808.531899:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881573888 00000100:00100000:3.0:1788526808.531939:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788526808.531948:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3281:x1875405881573888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526808.531997:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3281:x1875405881573888:12345-0@lo:400:kworker.0 Request processed in 49us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526808.532005:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788526808.532250:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881573888:0@lo:400:kworker.0 00000100:00100000:3.0:1788526808.532314:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574016 00000100:00100000:3.0:1788526808.532318:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574016 00000100:00100000:3.0:1788526808.532340:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526808.532345:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875405881574016:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788526808.532367:0:14318:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788526808.532430:0:14318:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x367645d450b3b31e 00000004:00100000:3.0:1788526808.532453:0:14318:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788526808.532577:0:14318:0:(import.c:65:import_set_state_nolock()) ffff98c2741cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526808.532619:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875405881574016:12345-0@lo:38:kworker.0 Request processed in 273us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526808.532626:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788526808.532656:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27477b800 x1875405881574016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788526808.532670:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788526808.532677:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788526808.532681:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788526808.532683:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c2741cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788526808.532688:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875405881574016:0@lo:38:kworker.0 00000001:02000400:0.0:1788526808.718793:0:14597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788526808.724521:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526809.750717:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526810.772572:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526811.797052:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788526812.158283:0:14748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7f615aa0 20000000:00000080:0.0:1788526812.158305:0:14748:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c274c9e800 uarg=0000000000000000 20000000:01000000:0.0:1788526812.158345:0:14748:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788526812.158355:0:14748:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788526812.158361:0:14748:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788526812.165374:0:14749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788526812.165644:0:14748:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788526812.173662:0:14748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788526812.179165:0:14748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526812.179196:0:14748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b2df expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526812.179217:0:14748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526812.179272:0:14748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 11 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526812.179289:0:14748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 11 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526812.179305:0:14748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14748:1875405881574144:0@lo:104: 00000100:00100000:3.0:1788526812.180637:0:14748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526812.180742:0:14748:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551300 going to sleep for 11 seconds 00000100:00100000:1.0:1788526812.184215:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574144 00000100:00100000:1.0:1788526812.184231:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574144 00000100:00100000:0.0:1788526812.184483:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788526812.184496:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14748:x1875405881574144:12345-0@lo:104: 00010000:00010000:0.0:1788526812.184518:0:14299:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.184638:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788526812.184645:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14748:x1875405881574144:12345-0@lo:104: Request processed in 152us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526812.184652:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526812.184679:0:14748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14748:1875405881574144:0@lo:104: 00010000:00010000:3.0:1788526812.184709:0:14748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526812.184924:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526812.184931:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526812.184939:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:1.0:1788526812.184943:0:14305:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526812.184952:0:14305:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788526812.184960:0:14305:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526812.184965:0:14305:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788526812.185009:0:14305:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526812.185016:0:14305:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788526812.185066:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881574272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526812.185107:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788526812.185174:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526812.185183:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574272 00000100:00100000:0.0:1788526812.185198:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574272 00010000:00010000:1.0:1788526812.185200:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b2df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b2e6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185228:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526812.185229:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526812.185231:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526812.185233:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526812.185252:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788526812.185259:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3281:x1875405881574272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526812.185260:0:14302:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788526812.185268:0:14302:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788526812.185270:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526812.185275:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185284:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185298:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c242c76400/0x367645d450b3b2e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b2df expref: 12 pid: 14308 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185312:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185320:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185333:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185340:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185347:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185353:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185362:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526812.185366:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185373:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185406:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.185416:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526812.187727:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:3281:x1875405881574272:12345-0@lo:103:ldlm_bl.0 Request processed in 2457us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526812.187743:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788526812.188827:0:14748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.188981:0:14748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526812.188990:0:14748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c2743e6800/0x367645d450b3b325 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526812.193566:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881574272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788526812.627591:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526802/real 1788526802] req@ffff98c27b8e3b80 x1875405881571328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526812.627626:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27b8e3b80 x1875405881571328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526812.627634:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526802/real 1788526802] req@ffff98c27b8e0700 x1875405881571200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526812 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526812.627660:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27b8e0700 x1875405881571200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526812 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788526812.627693:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526812.627711:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788526812.627714:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881571328:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788526812.627719:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24823a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526812.627724:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788526812.627727:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881571200:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788526812.627761:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788526812.627765:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788526812.627767:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c24823a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788526812.627772:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788526812.627777:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788526812.627784:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c24823a000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526812.627816:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e0700 x1875405881574400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788526812.627831:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788526812.627834:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788526812.627836:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788526812.627840:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788526812.627842:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788526812.627846:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526812.627857:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e3b80 x1875405881574528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788526812.627908:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881574656:0@lo:400:kworker.0 00000100:00100000:0.0:1788526812.627981:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526812.628056:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574656 00000100:00100000:0.0:1788526812.628063:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574656 00000100:00100000:0.0:1788526812.628108:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526812.628118:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526812.628165:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881574656:12345-0@lo:400:kworker.0 Request processed in 49us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526812.628171:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788526812.628216:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27b8e2680 x1875405881574656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526812.628226:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881574656:0@lo:400:kworker.0 00000100:00100000:0.0:1788526812.628241:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881574400:0@lo:8:kworker.0 00000400:00000100:0.0:1788526812.628266:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875405881574400 offset 0 length 520: 4 00000100:00100000:0.0:1788526812.628284:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881574528:0@lo:8:kworker.0 00000400:00000100:0.0:1788526812.628318:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875405881574528 offset 0 length 520: 4 00010000:00010000:2.0:1788526812.820245:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526813.843674:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788526813.843953:0:14313:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788526813.843958:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c244e62800 from 10 10000000:01000000:2.0:1788526813.843963:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788526813.844013:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526813.844025:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526813.844037:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526813.844064:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881574784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788526813.844146:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526813.844228:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c249d88600 going to sleep for 11 seconds 00000100:00100000:0.0:1788526813.844299:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574784 00000100:00100000:0.0:1788526813.844307:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574784 00000100:00100000:0.0:1788526813.844367:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788526813.844376:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+11:14313:x1875405881574784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526813.844409:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526813.844424:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b32c expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526813.844467:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b32c expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526813.844479:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b32c expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526813.844488:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821200, rc 0) 00000100:00100000:0.0:1788526813.844537:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881574784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526813.844544:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788526813.844638:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881574784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526813.844655:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526813.844666:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526813.844705:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881574912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526813.844728:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526813.844759:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c249d88600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526813.844779:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881574912 00000100:00100000:3.0:1788526813.844786:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881574912 00000100:00100000:3.0:1788526813.844825:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788526813.844834:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881574912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526813.845211:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881574912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526813.845218:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788526813.845299:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881574912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526813.845333:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881575040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526813.845376:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526813.845446:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c249d88600 going to sleep for 11 seconds 00000100:00100000:3.0:1788526813.845584:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575040 00000100:00100000:3.0:1788526813.845589:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575040 00000100:00100000:3.0:1788526813.845622:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788526813.845629:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881575040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526813.845790:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14313:x1875405881575040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526813.845798:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788526813.845921:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881575040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526813.846913:0:14811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788526813.847216:0:14313:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788526813.847227:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788526813.847236:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526813.847247:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526814.875679:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788526815.318943:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788526815.893025:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526816.917872:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788526817.730058:0:14999:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788526817.730062:0:14999:0:(obd_mount.c:928:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788526817.730337:0:14999:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c2482e8000 00000020:01000004:1.0:1788526817.730450:0:14999:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788526817.730465:0:14999:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788526817.730481:0:14999:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98c142aa4c80) 00000020:00000080:1.0:1788526817.730500:0:14999:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00000100:00080000:3.0:1788526817.747683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788526817.747689:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788526817.747699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788526817.747702:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788526817.747749:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881575296:0@lo:400:kworker.0 00000100:00100000:3.0:1788526817.747819:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526817.747895:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575296 00000100:00100000:3.0:1788526817.747902:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575296 00000100:00100000:3.0:1788526817.747961:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526817.747970:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881575296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526817.748021:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881575296:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526817.748028:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788526817.748070:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c274779c00 x1875405881575296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526817.748086:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881575296:0@lo:400:kworker.0 00000100:00100000:0.0:1788526817.748182:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881575168:0@lo:400:kworker.0 00000100:00100000:0.0:1788526817.748230:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526817.748824:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575168 00000100:00100000:3.0:1788526817.748830:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575168 00000100:00100000:3.0:1788526817.748872:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526817.748880:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3279:x1875405881575168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526817.748935:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:3279:x1875405881575168:12345-0@lo:400:kworker.0 Request processed in 56us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526817.748941:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788526817.749054:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881575168:0@lo:400:kworker.0 00100000:10000000:1.0:1788526817.758780:0:14999:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788526817.759328:0:14999:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788526817.760841:0:14999:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788526817.761303:0:14999:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788526817.761722:0:14999:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788526817.762579:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 515: rc = 0 00100000:10000000:0.0:1788526817.762784:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 515: rc = 0 00100000:10000000:0.0:1788526817.762917:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 515: rc = 0 00100000:10000000:0.0:1788526817.763867:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 776: rc = 0 00100000:10000000:0.0:1788526817.764563:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 776: rc = 0 00100000:10000000:0.0:1788526817.764906:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 776: rc = 0 00100000:10000000:0.0:1788526817.765858:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:0.0:1788526817.766548:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:0.0:1788526817.766888:0:14999:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 776: rc = 0 00000020:00000080:0.0:1788526817.767857:0:14999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788526817.767868:0:14999:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788526817.767880:0:14999:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x367645d450b3b341 00000020:01000004:0.0:1788526817.767889:0:14999:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788526817.767913:0:14999:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788526817.767917:0:14999:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788526817.767925:0:14999:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788526817.767930:0:14999:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788526817.767942:0:14999:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98c24967b300) 00000020:00000080:0.0:1788526817.768024:0:14999:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788526817.770556:0:14999:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788526817.770835:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788526817.770841:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788526817.777855:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788526817.777876:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788526817.778763:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788526817.778772:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788526817.784085:0:14999:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788526817.784663:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788526817.784670:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788526817.789064:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788526817.789076:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788526817.822435:0:14999:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526817.822688:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788526817.822818:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788526817.825128:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788526817.825144:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788526817.828922:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788526817.829059:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788526817.834063:0:14999:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788526817.834322:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788526817.834329:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788526817.835538:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788526817.835550:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788526817.940400:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526817.940537:0:14999:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788526817.940758:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788526817.940765:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788526817.945525:0:14999:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788526817.945545:0:14999:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788526817.947166:0:14999:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788526817.947213:0:14999:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788526817.947220:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788526817.947221:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526817.947223:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526817.947224:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526817.947225:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526817.947226:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526817.947233:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526817.947234:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526817.947236:0:14999:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526817.947239:0:14999:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788526817.947242:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788526817.947243:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526817.947243:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526817.947572:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526817.947574:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526817.947575:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526817.947576:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526817.947577:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526817.947578:0:14999:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788526817.947620:0:14999:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788526817.947645:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788526817.947798:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526817.947897:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c244d19480 going to sleep for 11 seconds 00000100:00100000:0.0:1788526817.947934:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575424 00000100:00100000:0.0:1788526817.947942:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575424 00000100:00100000:0.0:1788526817.948101:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788526817.948111:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14999:x1875405881575424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788526817.948145:0:14308:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788526817.948148:0:14308:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788526817.948159:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788526817.977228:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14999:x1875405881575424:12345-0@lo:253:mount.lustre.0 Request processed in 29107us (29419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526817.977245:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788526817.977331:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575424:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788526817.977349:0:14999:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788526817.977351:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788526817.977353:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788526817.977354:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788526817.977355:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788526817.977357:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788526817.977358:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788526817.977359:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788526817.977361:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788526817.977363:0:14999:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788526817.977571:0:14999:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c2482e8000 from lustre-OST0000 10000000:01000000:1.0:1788526817.977601:0:14999:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788526817.977604:0:14999:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788526817.977610:0:14999:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c2482e8000 10000000:01000000:1.0:1788526817.977615:0:14999:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526817.977632:0:14999:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:1.0:1788526817.989554:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788526818.006287:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788526818.006316:0:14999:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c2482e8000 from 1 10000000:01000000:1.0:1788526818.006321:0:14999:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788526818.008588:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.008609:0:14999:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.008622:0:14999:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526818.008647:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526818.008717:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.008859:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575552 00000100:00100000:0.0:1788526818.008868:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575552 00000100:00100000:0.0:1788526818.008927:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788526818.008936:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+12:14999:x1875405881575552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526818.008949:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526818.008962:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821600/0x367645d450b3b356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b34f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.008987:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821600/0x367645d450b3b356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b34f expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.009008:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821600/0x367645d450b3b356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b34f expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.009017:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821600, rc 0) 00000100:00100000:0.0:1788526818.009050:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575552:12345-0@lo:101:mount.lustre.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.009056:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788526818.009352:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.009374:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788526818.009433:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b356 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.009444:0:14999:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b356 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526818.009699:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526818.009732:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.012527:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2606169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.014514:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575680 00000100:00100000:3.0:1788526818.014530:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575680 00000100:00100000:2.0:1788526818.016476:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788526818.016491:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526818.017378:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575680:12345-0@lo:501:mount.lustre.0 Request processed in 886us (7641us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526818.017430:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788526818.017572:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575680:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788526818.017600:0:14999:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788526818.018068:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526818.018121:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526818.018214:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.021145:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575808 00000100:00100000:0.0:1788526818.021163:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575808 00000100:00100000:0.0:1788526818.021240:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788526818.021251:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.021802:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575808:12345-0@lo:501:mount.lustre.0 Request processed in 550us (3677us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526818.021811:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788526818.022110:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575808:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788526818.022264:0:14999:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788526818.022287:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b356 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.022300:0:14999:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245110800/0x367645d450b3b34f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b356 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526818.022311:0:14999:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c2482e8000 10000000:01000000:2.0:1788526818.022318:0:14999:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788526818.022343:0:14999:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788526818.022649:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788526818.022656:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788526818.022663:0:14999:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff98c24967cc80 10000000:01000000:2.0:1788526818.022667:0:14999:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788526818.022681:0:14999:0:(mgc_request.c:2062:mgc_process_log()) Process log nodemap-ffff98c24967cc80 from 1 10000000:01000000:2.0:1788526818.022684:0:14999:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788526818.022720:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.022729:0:14999:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.022799:0:14999:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526818.022887:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788526818.022937:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.023017:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.023122:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881575936 00000100:00100000:0.0:1788526818.023130:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881575936 00000100:00100000:0.0:1788526818.023176:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788526818.023193:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+13:14999:x1875405881575936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526818.023205:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526818.023221:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e820a00/0x367645d450b3b364 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b35d expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.023244:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e820a00/0x367645d450b3b364 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b35d expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.023256:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e820a00/0x367645d450b3b364 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b35d expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.023264:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820a00, rc 0) 00000100:00100000:0.0:1788526818.023433:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+14:14999:x1875405881575936:12345-0@lo:101:mount.lustre.0 Request processed in 240us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.023439:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788526818.023569:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881575936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526818.023583:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b364 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.023592:0:14999:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b364 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526818.023610:0:14999:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788526818.023624:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b364 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.023643:0:14999:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242c77400/0x367645d450b3b35d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b364 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526818.023651:0:14999:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788526818.023655:0:14999:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526818.023674:0:14999:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788526818.023940:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788526818.023947:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788526818.023953:0:14999:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788526818.023955:0:14999:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788526818.023976:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.023983:0:14999:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.024055:0:14999:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526818.024073:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788526818.024120:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.024187:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.024229:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576064 00000100:00100000:3.0:1788526818.024234:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576064 00000100:00100000:3.0:1788526818.024302:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788526818.024310:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+14:14999:x1875405881576064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526818.024320:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526818.024330:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7200/0x367645d450b3b372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b36b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.024363:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7200/0x367645d450b3b372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b36b expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.024379:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7200/0x367645d450b3b372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b36b expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.024436:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7200, rc 0) 00000100:00100000:3.0:1788526818.024483:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576064:12345-0@lo:101:mount.lustre.0 Request processed in 173us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.024490:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788526818.024599:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526818.024612:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b372 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526818.024620:0:14999:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b372 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526818.025309:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:2.0:1788526818.026217:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526818.026543:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788526818.026591:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:2.0:1788526818.026627:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:2.0:1788526818.026673:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:2.0:1788526818.026711:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:2.0:1788526818.026746:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:2.0:1788526818.026793:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:2.0:1788526818.026847:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:2.0:1788526818.026882:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:2.0:1788526818.026929:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:2.0:1788526818.026968:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:2.0:1788526818.027018:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:2.0:1788526818.027081:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:2.0:1788526818.027101:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:2.0:1788526818.027196:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526818.027262:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.028179:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242cbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.028243:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576192 00000100:00100000:0.0:1788526818.028251:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576192 00000100:00100000:0.0:1788526818.028296:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788526818.028305:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.028916:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576192:12345-0@lo:501:mount.lustre.0 Request processed in 429us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.028927:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788526818.029259:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526818.029311:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526818.029361:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.029405:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242cbb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.029514:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576320 00000100:00100000:0.0:1788526818.029520:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576320 00000100:00100000:0.0:1788526818.029559:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788526818.029566:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526818.030112:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576320:12345-0@lo:503:mount.lustre.0 Request processed in 545us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.030126:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788526818.030287:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788526818.031424:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788526818.031505:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788526818.031574:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526818.031605:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ff540 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.031980:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576448 00000100:00100000:0.0:1788526818.031987:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576448 00000100:00100000:0.0:1788526818.032109:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788526818.032118:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788526818.032368:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576448:12345-0@lo:502:mount.lustre.0 Request processed in 252us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.032375:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788526818.032649:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788526818.033088:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1788526818.033154:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:3.0:1788526818.033184:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:3.0:1788526818.033228:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:3.0:1788526818.033265:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:3.0:1788526818.033295:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:3.0:1788526818.033336:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:3.0:1788526818.033369:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:2.0:1788526818.034579:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:2.0:1788526818.034659:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:2.0:1788526818.034693:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:2.0:1788526818.035627:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:2.0:1788526818.035693:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526818.035959:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.036132:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242cbbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.036211:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576576 00000100:00100000:1.0:1788526818.036219:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576576 00000100:00100000:1.0:1788526818.036301:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788526818.036311:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526818.036574:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576576:12345-0@lo:502:mount.lustre.0 Request processed in 264us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526818.036588:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788526818.037561:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788526818.039019:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:3.0:1788526818.039041:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788526818.049949:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788526818.049963:0:15013:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788526818.049971:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526818.049973:0:15013:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788526818.049982:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788526818.050002:0:15013:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98c249678000) 00000020:00000080:0.0:1788526818.050027:0:15013:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788526818.050033:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788526818.050116:0:15013:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c2482e8000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788526818.050124:0:15013:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788526818.050132:0:15013:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x367645d450b3b380 00010000:00010000:0.0:1788526818.054727:0:15013:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788526818.055296:0:15013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788526818.059018:0:15013:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788526818.061450:0:15013:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788526818.061464:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526818.061477:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061479:0:15013:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788526818.061485:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788526818.061487:0:15013:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788526818.061489:0:15013:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788526818.061490:0:15013:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788526818.061492:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788526818.061494:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061496:0:15013:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788526818.061499:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526818.061502:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061503:0:15013:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788526818.061506:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788526818.061507:0:15013:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788526818.061509:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526818.061511:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061512:0:15013:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788526818.061515:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526818.061517:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061518:0:15013:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788526818.061521:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788526818.061583:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526818.061586:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526818.061588:0:15013:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788526818.061591:0:15013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:0.0:1788526818.061886:0:14999:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788526818.061904:0:14999:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788526818.061921:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b372 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.061934:0:14999:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242c76c00/0x367645d450b3b36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b372 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526818.061950:0:14999:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c2482e8000 from 1 10000000:01000000:0.0:1788526818.061953:0:14999:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788526818.061990:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.061998:0:14999:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.062009:0:14999:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526818.062032:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788526818.062118:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.062160:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.062274:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576704 00000100:00100000:3.0:1788526818.062282:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576704 00000100:00100000:3.0:1788526818.062329:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788526818.062339:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+15:14999:x1875405881576704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526818.062350:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526818.062362:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b387 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.062407:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b387 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.062427:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b387 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.062437:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6200, rc 0) 00000100:00100000:3.0:1788526818.062477:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881576704:12345-0@lo:101:mount.lustre.0 Request processed in 140us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.062483:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788526818.062714:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526818.062730:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.062830:0:14999:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526818.063660:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:0.0:1788526818.064038:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526818.065171:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788526818.065340:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:0.0:1788526818.065576:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:0.0:1788526818.065618:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:0.0:1788526818.065653:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:0.0:1788526818.066141:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:0.0:1788526818.066271:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:0.0:1788526818.066313:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:0.0:1788526818.066920:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788526818.066932:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:0.0:1788526818.067642:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.067721:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.067844:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.068694:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576832 00000100:00100000:1.0:1788526818.068708:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576832 00000100:00100000:1.0:1788526818.068776:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788526818.068786:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881576832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526818.069073:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881576832:12345-0@lo:501:mount.lustre.0 Request processed in 287us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526818.069081:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788526818.069860:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.069911:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526818.069975:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.070006:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.070330:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881576960 00000100:00100000:1.0:1788526818.070338:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881576960 00000100:00100000:1.0:1788526818.070939:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788526818.070951:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881576960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788526818.071195:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881576960:12345-0@lo:503:mount.lustre.0 Request processed in 247us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526818.071249:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788526818.074025:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881576960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788526818.075063:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526818.075166:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526818.075253:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.076562:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242cbbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.078603:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577088 00000100:00100000:3.0:1788526818.078614:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577088 00000100:00100000:3.0:1788526818.078660:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788526818.078669:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881577088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788526818.078965:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881577088:12345-0@lo:502:mount.lustre.0 Request processed in 295us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.078974:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788526818.079198:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788526818.082102:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1788526818.082207:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:2.0:1788526818.082263:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:2.0:1788526818.082324:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:2.0:1788526818.082360:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:2.0:1788526818.084973:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:2.0:1788526818.085065:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:2.0:1788526818.085123:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:2.0:1788526818.085180:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526818.085274:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526818.085322:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c242cbbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.085467:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577216 00000100:00100000:0.0:1788526818.085475:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577216 00000100:00100000:0.0:1788526818.085551:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788526818.085561:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881577216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788526818.085969:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881577216:12345-0@lo:502:mount.lustre.0 Request processed in 407us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.085978:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788526818.086069:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788526818.086200:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1788526818.086212:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788526818.087935:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526818.087947:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526818.087950:0:15017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788526818.087956:0:15017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c2482e8000 00000020:00000080:1.0:1788526818.087959:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788526818.087966:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526818.087969:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526818.087971:0:15017:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788526818.087974:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526818.087987:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526818.087989:0:15017:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788526818.087993:0:15017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c2482e8000 00000020:00000080:1.0:1788526818.087995:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788526818.088111:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788526818.088115:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526818.088116:0:15017:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788526818.088119:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788526818.088121:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788526818.088123:0:15017:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788526818.088126:0:15017:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c2482e8000 00000020:00000080:1.0:1788526818.088128:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788526818.094008:0:15017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526818.094023:0:15017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526818.094025:0:15017:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788526818.094030:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000020:01000000:1.0:1788526818.094229:0:14999:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788526818.094243:0:14999:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788526818.094267:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.094279:0:14999:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788526818.094332:0:14999:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788526818.094336:0:14999:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c2482e8000 10000000:01000000:1.0:1788526818.094341:0:14999:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c2482e8000 10000000:01000000:1.0:1788526818.094345:0:14999:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788526818.094358:0:14999:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0000-osd 00000040:01000000:1.0:1788526818.094494:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788526818.094504:0:14999:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788526818.094516:0:14999:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c2482e8000 from 1 10000000:01000000:1.0:1788526818.094520:0:14999:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788526818.094562:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.094571:0:14999:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526818.094592:0:14999:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526818.094620:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788526818.094700:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.094952:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577344 00000100:00100000:0.0:1788526818.094960:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577344 00000100:00100000:0.0:1788526818.095004:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788526818.095013:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881577344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526818.095027:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526818.095047:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821800/0x367645d450b3b39c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b395 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.095073:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821800/0x367645d450b3b39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b395 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.095085:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821800/0x367645d450b3b39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b395 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.095108:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821800, rc 0) 00000100:00100000:0.0:1788526818.095152:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577344:12345-0@lo:101:mount.lustre.0 Request processed in 141us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.095159:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788526818.095542:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2580246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526818.095572:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274961880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526818.095589:0:14999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b39c expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.095599:0:14999:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b39c expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788526818.096230:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788526818.096560:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788526818.096819:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1788526818.096862:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:0.0:1788526818.096894:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:0.0:1788526818.096935:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:0.0:1788526818.096970:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:0.0:1788526818.097036:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:0.0:1788526818.097074:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:0.0:1788526818.097130:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:0.0:1788526818.097187:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:0.0:1788526818.097227:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:0.0:1788526818.097260:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:0.0:1788526818.097301:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:0.0:1788526818.097352:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:0.0:1788526818.097421:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:0.0:1788526818.097475:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:0.0:1788526818.097509:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:0.0:1788526818.097539:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:0.0:1788526818.097583:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:0.0:1788526818.097617:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:0.0:1788526818.097652:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:0.0:1788526818.097697:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:0.0:1788526818.097733:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:0.0:1788526818.097765:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:0.0:1788526818.097810:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:0.0:1788526818.097842:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 128 off12440 00000040:00080000:0.0:1788526818.097868:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12664 00000040:00080000:0.0:1788526818.097904:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12888 00000040:00080000:0.0:1788526818.097931:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off12968 00000040:00080000:0.0:1788526818.097974:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13192 00000040:00080000:0.0:1788526818.098014:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13416 00000040:00080000:0.0:1788526818.098043:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13504 00000040:00080000:0.0:1788526818.098068:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13632 00000040:00080000:0.0:1788526818.098110:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13776 00000040:00080000:0.0:1788526818.098151:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13904 00000040:00080000:0.0:1788526818.098179:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14128 00000040:00080000:0.0:1788526818.098215:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14352 00000040:00080000:0.0:1788526818.098249:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14432 00000040:00080000:0.0:1788526818.098278:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14656 00000040:00080000:0.0:1788526818.098318:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14880 00000040:00080000:0.0:1788526818.098349:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 120 off15000 00000040:00080000:0.0:1788526818.108006:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 224 off15224 00000040:00080000:0.0:1788526818.108032:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788526818.108141:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.108217:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.108263:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.112660:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577472 00000100:00100000:3.0:1788526818.112676:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577472 00000100:00100000:3.0:1788526818.113147:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788526818.113157:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526818.113501:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577472:12345-0@lo:501:mount.lustre.0 Request processed in 344us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.113509:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788526818.113981:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526818.114032:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526818.114097:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.114135:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a58f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.114250:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577600 00000100:00100000:3.0:1788526818.114256:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577600 00000100:00100000:3.0:1788526818.114292:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788526818.114299:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788526818.114512:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577600:12345-0@lo:503:mount.lustre.0 Request processed in 212us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.114525:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788526818.115501:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788526818.116492:0:14999:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526818.116583:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526818.116665:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526818.117698:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c258024f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.117850:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577728 00000100:00100000:3.0:1788526818.117858:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577728 00000100:00100000:3.0:1788526818.117914:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788526818.117923:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788526818.118176:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577728:12345-0@lo:502:mount.lustre.0 Request processed in 253us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.118184:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788526818.119284:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788526818.120108:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788526818.120179:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:1.0:1788526818.120214:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:1.0:1788526818.120258:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:1.0:1788526818.120290:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:1.0:1788526818.120331:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:1.0:1788526818.120361:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:1.0:1788526818.120419:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:1.0:1788526818.120487:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:1.0:1788526818.120519:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:1.0:1788526818.120548:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:1.0:1788526818.120591:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:1.0:1788526818.120626:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:1.0:1788526818.120658:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:1.0:1788526818.120701:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:1.0:1788526818.120731:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:1.0:1788526818.124634:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:1.0:1788526818.124717:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:1.0:1788526818.125575:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:1.0:1788526818.125625:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:1.0:1788526818.125689:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:1.0:1788526818.125725:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:1.0:1788526818.125914:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:1.0:1788526818.126653:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:1.0:1788526818.126730:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 128 off12440 00000040:00080000:1.0:1788526818.128943:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12664 00000040:00080000:1.0:1788526818.129107:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12888 00000040:00080000:1.0:1788526818.129147:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off12968 00000040:00080000:1.0:1788526818.129181:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13192 00000040:00080000:1.0:1788526818.129231:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13416 00000040:00080000:1.0:1788526818.129266:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13504 00000040:00080000:1.0:1788526818.129299:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13632 00000040:00080000:1.0:1788526818.129333:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13776 00000040:00080000:1.0:1788526818.129380:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13904 00000040:00080000:1.0:1788526818.129471:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14128 00000040:00080000:1.0:1788526818.129519:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14352 00000040:00080000:1.0:1788526818.129552:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14432 00000040:00080000:1.0:1788526818.129581:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14656 00000040:00080000:1.0:1788526818.129628:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14880 00000040:00080000:1.0:1788526818.129661:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 120 off15000 00000100:00100000:1.0:1788526818.129714:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526818.136298:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526818.136347:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c258024f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.136417:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577856 00000100:00100000:1.0:1788526818.136436:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577856 00000100:00100000:1.0:1788526818.136489:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788526818.136499:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526818.138287:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881577856:12345-0@lo:502:mount.lustre.0 Request processed in 1780us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526818.138302:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788526818.138415:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881577856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788526818.138580:0:14999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 224 off15224 00000040:00080000:1.0:1788526818.138595:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788526818.142986:0:15022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788526818.143005:0:15022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98c249679980) 00000020:00000080:0.0:1788526818.143029:0:15022:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788526818.143138:0:15022:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c2482e8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788526818.143144:0:15022:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c2482e8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788526818.143147:0:15022:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c2482e8000 3 00010000:00080000:0.0:1788526818.143183:0:15022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c249723800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1788526818.145066:0:15022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788526818.147025:0:15022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788526818.147150:0:15022:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788526818.147164:0:15022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x367645d450b3b3aa 00000100:00080000:0.0:1788526818.147176:0:15022:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788526818.147183:0:15022:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98c249723800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526818.147221:0:15022:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e2d80 x1875405881577984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788526818.147265:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881577984:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788526818.147336:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.148880:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881577984 00000100:00100000:0.0:1788526818.148902:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881577984 00000100:00100000:0.0:1788526818.148953:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788526818.148960:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3277:x1875405881577984:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788526818.148987:0:14318:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:0.0:1788526818.149024:0:14318:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x367645d450b3b3b1 00000004:00100000:0.0:1788526818.149043:0:14318:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788526818.149564:0:14318:0:(import.c:65:import_set_state_nolock()) ffff98c2466d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526818.149653:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875405881577984:12345-0@lo:38:llog_process_th.0 Request processed in 691us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526818.149664:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788526818.151039:0:15022:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788526818.151603:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788526818.151610:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788526818.151613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788526818.151616:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788526818.152625:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98c27b8e2d80 x1875405881577984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526818.152653:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788526818.152666:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788526818.152677:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788526818.152683:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788526818.152686:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c249723800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788526818.153135:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3277:1875405881577984:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788526818.153935:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 42 count 42 00000020:01000000:0.0:1788526818.154410:0:14999:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788526818.154778:0:14999:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788526818.154802:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b39c expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.154816:0:14999:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245111000/0x367645d450b3b395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b39c expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788526818.154871:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788526818.154878:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788526818.154879:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788526818.154881:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788526818.154882:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788526818.154883:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788526818.154885:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788526818.154887:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788526818.154889:0:14999:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788526818.154893:0:14999:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788526818.154895:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788526818.154901:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788526818.154903:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788526818.154904:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788526818.154905:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788526818.154905:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788526818.154906:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788526818.154907:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788526818.154908:0:14999:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788526818.154940:0:14999:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788526818.154962:0:14999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881578112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788526818.155041:0:14999:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.155436:0:14999:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788526818.162200:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578112 00000100:00100000:1.0:1788526818.162217:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578112 00000100:00100000:1.0:1788526818.162346:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788526818.162358:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14999:x1875405881578112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788526818.162414:0:14310:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788526818.162443:0:14310:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788526818.228520:0:14310:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788526818.228545:0:14310:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788526818.228609:0:14332:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788526818.228616:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788526818.228644:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.228664:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b310 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.228674:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.228845:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 17 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526818.228890:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 17 pid: 14308 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526818.228911:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881578240:0@lo:104: 00000100:00100000:0.0:1788526818.228982:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526818.229029:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24555bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526818.229073:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578240 00000100:00100000:3.0:1788526818.229083:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578240 00000100:00100000:3.0:1788526818.229145:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526818.229154:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881578240:12345-0@lo:104: 00010000:00010000:3.0:1788526818.229179:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229245:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788526818.229251:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881578240:12345-0@lo:104: Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.229259:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788526818.229282:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526818.229288:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229296:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526818.229300:0:14304:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229321:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526818.229321:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881578240:0@lo:104: 10000000:00010000:3.0:1788526818.229334:0:14304:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526818.229340:0:14304:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788526818.229346:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229375:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229382:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526818.229444:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229451:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c26e821a00/0x367645d450b3b310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b317 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229473:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526818.229475:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526818.229477:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526818.229505:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881578368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526818.229540:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526818.229601:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578368 00000100:00100000:3.0:1788526818.229605:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578368 00010000:00010000:3.0:1788526818.229623:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 18 pid: 14308 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526818.229647:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526818.229654:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:3281:x1875405881578368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526818.229684:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526818.229691:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 18 pid: 14308 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229710:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 18 pid: 14308 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229722:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c2743e6400/0x367645d450b3b317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b310 expref: 18 pid: 14308 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229735:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229743:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788526818.229756:0:14303:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009419535s 00010000:00010000:3.0:1788526818.229761:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229768:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229775:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229781:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229786:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526818.229791:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229805:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229820:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229830:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526818.229861:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3281:x1875405881578368:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526818.229868:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526818.229901:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881578368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526818.229916:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229923:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526818.229930:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821400/0x367645d450b3b3b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526818.240487:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14999:x1875405881578112:12345-0@lo:253:mount.lustre.0 Request processed in 78117us (85431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526818.240504:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788526818.240627:0:14999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:14999:1875405881578112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788526818.240646:0:14999:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788526818.240667:0:14999:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526818.240669:0:14999:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788526818.240670:0:14999:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526818.240671:0:14999:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526818.240673:0:14999:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526818.240674:0:14999:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526818.240676:0:14999:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526818.240678:0:14999:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526818.240679:0:14999:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788526818.240699:0:14999:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788526818.251129:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526818.251319:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526818.251569:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526818.251715:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788526818.252334:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788526818.252878:0:14999:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788526818.256881:0:14999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788526818.343665:0:14999:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788526818.343675:0:14999:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788526818.343719:0:14999:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788526818.343787:0:14999:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788526818.963570:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526819.990805:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788526820.189771:0:14313:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788526820.189780:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c244e62800 from 7 10000000:01000000:1.0:1788526820.189784:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788526820.189831:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526820.189845:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526820.189860:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526820.189891:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881578496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788526820.189964:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526820.190032:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2580246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526820.191755:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578496 00000100:00100000:3.0:1788526820.191771:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578496 00000100:00100000:3.0:1788526820.191857:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788526820.191869:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+16:14313:x1875405881578496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526820.191889:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526820.191909:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b3bf expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526820.193534:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b3bf expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526820.193552:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b3bf expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526820.193563:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7c00, rc 0) 00000100:00100000:3.0:1788526820.193652:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14313:x1875405881578496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1785us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526820.193660:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788526820.194154:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881578496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526820.194176:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526820.194185:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526820.194251:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881578624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788526820.194292:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526820.194324:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2580246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788526820.194973:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578624 00000100:00100000:0.0:1788526820.194983:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578624 00000100:00100000:0.0:1788526820.195044:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788526820.195064:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14313:x1875405881578624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788526820.195083:0:14310:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788526820.195101:0:14310:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788526820.195104:0:14310:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788526820.195205:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:14313:x1875405881578624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526820.195213:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788526820.195218:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881578624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788526820.195287:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788526820.195297:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526820.195311:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526821.012833:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526822.036238:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526823.059634:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526823.382423:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788526823.382432:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788526823.382435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788526823.382438:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788526823.382508:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881578752:0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.382599:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526823.382658:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526823.382665:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881578880:0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.382697:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526823.382723:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578880 00000100:00100000:1.0:1788526823.382732:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881579008:0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.382758:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526823.382792:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881578752 00000100:00100000:1.0:1788526823.382796:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578752 00000100:00100000:1.0:1788526823.382843:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788526823.382852:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3278:x1875405881578752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.382905:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3278:x1875405881578752:12345-0@lo:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526823.382912:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788526823.382945:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579008 00000100:00100000:1.0:1788526823.382949:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579008 00000100:00100000:3.0:1788526823.382955:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881578880 00000100:00100000:1.0:1788526823.382982:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526823.383014:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881579008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.383063:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881579008:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526823.383069:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788526823.383081:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526823.383086:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881578880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526823.383113:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881578880:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526823.383119:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788526823.393218:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788526823.397490:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274962d80 x1875405881579008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526823.397513:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881579008:0@lo:400:kworker.0 00010000:00080000:2.0:1788526823.404560:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274961c00 x1875405881578880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526823.404582:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881578880:0@lo:400:kworker.0 00000100:00100000:2.0:1788526823.404597:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881578752:0@lo:400:kworker.0 00010000:00010000:3.0:1788526824.083545:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526825.107964:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788526825.469641:0:15369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1788526825.556868:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788526826.132226:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.155937:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526827.353825:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526812/real 1788526812] req@ffff98c27b8e0700 x1875405881574400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526827.353869:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27b8e0700 x1875405881574400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526827.353902:0:3277:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788526812/real 1788526812] req@ffff98c27b8e3b80 x1875405881574528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526827.353929:0:3277:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98c27b8e3b80 x1875405881574528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788526827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788526827.353957:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24823a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526827.353979:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788526827.353983:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881574400:0@lo:8:kworker.0 00000100:00080000:0.0:1788526827.353988:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526827.353993:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788526827.353996:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881574528:0@lo:8:kworker.0 00000100:00080000:0.0:1788526827.355370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788526827.355377:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788526827.355382:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c24823a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788526827.355409:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788526827.355417:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788526827.355425:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98c24823a000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526827.355453:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e0700 x1875405881579264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788526827.355468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788526827.355471:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788526827.355473:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788526827.355476:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1788526827.355479:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788526827.355494:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1788526827.355507:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c27b8e0a80 x1875405881579392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526827.355773:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881579136:0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.355870:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.364217:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881579520:0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.364324:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.364408:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526827.364420:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881579648:0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.364454:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.364499:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579520 00000100:00100000:3.0:1788526827.364510:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579520 00000100:00100000:3.0:1788526827.364582:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579648 00000100:00100000:3.0:1788526827.364586:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579648 00000100:00100000:3.0:1788526827.364620:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526827.364643:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881579520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.365150:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881579520:12345-0@lo:400:kworker.0 Request processed in 506us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526827.365158:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526827.365186:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526827.365194:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881579648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.365225:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881579648:12345-0@lo:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526827.365230:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788526827.365255:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788526827.365293:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27b8e1c00 x1875405881579648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526827.365309:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881579648:0@lo:400:kworker.0 00010000:00080000:3.0:1788526827.365320:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27b8e0380 x1875405881579520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526827.365327:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881579520:0@lo:400:kworker.0 00000100:00100000:0.0:1788526827.365740:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579136 00000100:00100000:0.0:1788526827.365747:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579136 00000100:00100000:0.0:1788526827.365785:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788526827.365793:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3281:x1875405881579136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526827.365842:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3281:x1875405881579136:12345-0@lo:400:kworker.0 Request processed in 50us (9973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526827.365850:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788526827.365891:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881579264:0@lo:8:kworker.0 00000100:00100000:0.0:1788526827.365938:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526827.365974:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881579392:0@lo:8:kworker.0 00000100:00100000:0.0:1788526827.365996:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526827.366055:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881579136:0@lo:400:kworker.0 00000100:00100000:3.0:1788526827.368633:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579264 00000100:00100000:3.0:1788526827.368657:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579264 00000100:00100000:3.0:1788526827.368722:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579392 00000100:00100000:3.0:1788526827.368725:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579392 00000100:00100000:3.0:1788526827.368746:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526827.368756:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875405881579264:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788526827.368799:0:15002:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1788526827.368852:0:15002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3b3cd 00002000:00100000:3.0:1788526827.368874:0:15002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98c24317b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788526827.368897:0:15002:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788526827.368901:0:15002:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788526827.369370:0:15002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788526827.369446:0:15002:0:(import.c:65:import_set_state_nolock()) ffff98c24317d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788526827.369565:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875405881579264:12345-0@lo:8:kworker.0 Request processed in 808us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526827.369575:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526827.369608:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526827.369613:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875405881579392:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788526827.369629:0:15002:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788526827.369664:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875405881579392:12345-0@lo:8:kworker.0 Request processed in 50us (3667us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788526827.369671:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788526827.371278:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27b8e0700 x1875405881579264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788526847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526827.371295:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788526827.371309:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788526827.371321:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788526827.371330:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788526827.371334:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c24823a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788526827.371368:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788526827.371377:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881579264:0@lo:8:kworker.0 00000100:00080000:0.0:1788526827.371414:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788526827.371436:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788526827.371440:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881579392:0@lo:8:kworker.0 00000004:00080000:3.0:1788526827.372199:0:14339:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788526827.372228:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1875405881579904:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788526827.372313:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.372349:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526827.372416:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881579776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526827.372450:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.372710:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579904 00000100:00100000:3.0:1788526827.372718:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579904 00000100:00100000:3.0:1788526827.372788:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526827.372797:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14339:x1875405881579904:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788526827.379722:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881579776 00000100:00100000:0.0:1788526827.379741:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881579776 00000100:00100000:0.0:1788526827.379821:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788526827.379834:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881579776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788526827.379883:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788526827.380007:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881579776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526827.380015:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788526827.380096:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274779f80 x1875405881579776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526827.380123:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881579776:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788526827.380756:0:14338:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788526827.381321:0:14338:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 462721933393ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788526827.381451:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788526827.383145:0:15002:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788526827.383158:0:15002:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788526827.383166:0:15002:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1788526827.407531:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.407546:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407580:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.407585:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.407593:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407617:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407631:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407640:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407668:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.407702:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.407710:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407718:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.407724:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407735:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407768:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407777:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.407798:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.407800:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.407802:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.408422:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.408430:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.408440:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.408444:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.408448:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.408458:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.408467:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.408475:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.408511:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526827.408767:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.408775:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.408784:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.408788:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.408797:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.408826:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.408833:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b3db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.408849:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.408851:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.408853:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.413202:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.413226:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.413252:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.413257:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.413265:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.413282:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.413294:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.413302:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.413335:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526827.413657:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526827.413665:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.413675:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526827.413750:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.413761:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.413786:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.413794:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0b7539/0x367645d450b3b3e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.413831:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.413833:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.413835:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.414813:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.414823:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414836:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.414848:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.414855:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414869:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414879:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414887:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414905:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.414929:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.414934:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414942:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.414946:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414954:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414967:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.414986:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b3e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.415002:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.415004:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.415006:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.417338:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.417356:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417377:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.417382:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.417410:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417427:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417439:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417448:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417469:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.417489:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.417504:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417512:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.417518:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.417529:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.418756:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.418774:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b3f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.418798:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.418800:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.418802:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.421957:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.421973:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.421996:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.422001:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.422010:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422041:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422054:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422064:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422088:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.422104:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.422111:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422120:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.422125:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422136:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422159:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422168:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b3f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422196:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.422198:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.422200:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.422651:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.422658:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422667:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.422671:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.422675:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422685:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422693:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422701:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422717:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.422726:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.422731:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422751:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.422755:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422764:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.422777:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.425237:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b3fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.425271:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.425273:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.425275:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.427685:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.427702:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427724:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.427729:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.427736:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427752:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427772:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427779:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427806:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.427826:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.427833:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427841:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.427848:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427860:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427885:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427893:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.427928:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.427938:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.427940:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.428470:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.428477:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428489:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.428493:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.428498:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428510:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428519:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428528:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428544:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.428555:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.428560:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428568:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.428571:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428591:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428605:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428613:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b40c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.428627:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.428628:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.428630:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.431293:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.431313:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431334:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.431339:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.431346:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431361:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431374:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431412:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431434:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.431451:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.431458:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431467:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.431472:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431482:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431502:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431510:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b413 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.431532:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.431534:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.431536:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.436609:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.436636:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436662:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.436668:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.436686:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436704:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436717:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436728:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436753:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.436769:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.436777:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436785:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.436791:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436801:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436830:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436838:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b41a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.436860:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.436862:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.436864:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.439802:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.439820:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439843:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.439848:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.439856:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439872:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439885:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439894:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439945:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.439966:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.439973:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439981:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.439986:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.439996:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.440016:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.440978:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.441012:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.441014:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.441017:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.441999:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.442011:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443431:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.443456:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.443467:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443489:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443502:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443511:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443538:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788526827.443560:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526827.443567:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443576:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526827.443582:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443592:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443613:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443634:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.443662:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.443664:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.443666:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.447870:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.447890:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.447924:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.447930:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.449955:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.449999:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.450015:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.450023:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.450060:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526827.450794:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.450805:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.450817:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.450822:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.450834:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.450859:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.450867:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b42f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.450920:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.450922:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.450924:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.451221:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.451233:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.451247:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.451252:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.451259:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.451269:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.451278:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.451285:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.451348:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788526827.452213:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.452223:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.452236:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.452240:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.452245:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.452257:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.452276:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.452283:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455815:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788526827.455836:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455854:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.455861:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455876:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455903:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455924:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.455993:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.455999:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.456007:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.456024:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.456032:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.456043:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.456051:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.456053:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.456055:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.456176:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788526827.456188:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b43d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.456861:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.459931:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.459950:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.459972:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.459977:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.460193:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.460216:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.460228:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.460254:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.460318:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788526827.461060:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.461070:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.461082:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.461086:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.461091:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.461103:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.461112:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.461119:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.463102:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788526827.463116:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.463129:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.463135:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.463147:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.463174:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.463182:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1a68802/0x367645d450b3b444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.463307:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526827.463314:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.463321:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526827.463324:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.463331:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.463342:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.463350:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.463351:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.463353:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526827.463491:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788526827.463501:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b44b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.464671:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.465332:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.465345:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.465363:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.465369:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.465376:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.465427:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.465439:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.465447:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.465464:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788526827.466159:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.466168:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.466178:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.466182:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.466194:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.466204:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.466213:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.466220:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.466243:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788526827.466846:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526827.466857:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466868:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526827.466874:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466893:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466926:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466934:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edc38825/0x367645d450b3b452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466959:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526827.466963:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466970:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526827.466973:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466981:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466990:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.466997:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3d2176/0x367645d450b3b459 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.467023:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.467025:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.467027:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.468820:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.479281:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.479302:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.479326:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.479331:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.479339:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.479354:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.479367:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.479413:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.479435:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526827.480016:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526827.480027:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.480038:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526827.480044:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.480055:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.480082:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.480090:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d074945b/0x367645d450b3b460 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.480116:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.480118:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.480120:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.485863:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.485882:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.485916:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.485923:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.485931:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.485951:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.485964:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.485972:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.486000:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526827.486987:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.487000:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.487014:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.487020:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.487031:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.487055:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.487062:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcdc7d9c/0x367645d450b3b467 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.487088:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.487090:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.487092:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.487477:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.487486:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.487507:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.487512:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.487519:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.487534:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.487545:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.490810:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.491309:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526827.491835:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.491846:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.491860:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.491875:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.491890:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.491931:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.492580:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ed9881d/0x367645d450b3b46e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.492608:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.492610:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.492612:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788526827.492764:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.492774:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.492789:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.492794:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.492803:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.492816:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.492838:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.492845:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.492868:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788526827.493349:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.493356:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.493367:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.493370:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.493374:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.493383:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.493422:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.493429:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.493456:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788526827.493665:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788526827.493672:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493691:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.493696:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493706:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493723:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493739:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcf60369/0x367645d450b3b475 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493758:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526827.493761:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493767:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526827.493770:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493778:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493789:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493796:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077efa944/0x367645d450b3b47c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.493808:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.493810:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.493812:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526827.493820:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788526827.494232:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788526827.495331:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526827.495343:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.495362:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=462s v=(0 0) 00010000:00010000:3.0:1788526827.495365:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526827.495372:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.495407:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.495419:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.495426:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526827.495452:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526827.497724:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526827.497740:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.497755:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526827.497762:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.497773:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.497799:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.497807:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d73b6c65/0x367645d450b3b483 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526827.497842:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.497844:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526827.497846:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526827.501532:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526827.501549:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.503968:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788526827.503974:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526827.503985:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.504004:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.504019:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.504028:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.504070:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526827.504137:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526827.504147:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.504156:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526827.504161:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.504183:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.504204:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.504212:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e310e9/0x367645d450b3b48a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.504237:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.504239:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.504241:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526827.507204:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526827.507226:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.507248:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1788526827.507254:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526827.507261:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.507278:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.507304:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.507312:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526827.507348:0:15002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526827.508801:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526827.508815:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.508831:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526827.508837:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.508848:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.508883:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.508916:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3c168a/0x367645d450b3b491 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526827.508945:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.508947:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526827.508949:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788526827.509978:0:15002:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788526827.511927:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14339:x1875405881579904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139107us (139590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526827.511953:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526827.512625:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1875405881579904:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788526827.512649:0:14339:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788526827.512850:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1875405881580032:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788526827.512934:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526827.513008:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526827.513082:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580032 00000100:00100000:0.0:1788526827.513091:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580032 00000100:00100000:0.0:1788526827.513146:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788526827.513155:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14339:x1875405881580032:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788526827.513218:0:15003:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788526827.544313:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14339:x1875405881580032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 31145us (31365us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788526827.544331:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526827.544611:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14339:1875405881580032:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788526827.544636:0:14339:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788526828.180068:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788526828.713836:0:6693:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788526828.713976:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788526829.211125:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526830.228216:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526831.255070:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526832.276045:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788526832.596476:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788526832.596484:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788526832.596488:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788526832.596498:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1788526832.596503:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788526832.596511:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526832.596533:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274963800 x1875405881580416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526832.596587:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881580160:0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.596660:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526832.596917:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788526832.596994:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881580672:0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597028:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526832.597064:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881580288:0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597090:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526832.597182:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788526832.597189:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881580544:0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597210:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526832.597241:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881580416:0@lo:8:kworker.0 00000100:00100000:1.0:1788526832.597265:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526832.597300:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580160 00000100:00100000:1.0:1788526832.597308:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580160 00000100:00100000:1.0:1788526832.597355:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788526832.597363:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3281:x1875405881580160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597436:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:3281:x1875405881580160:12345-0@lo:400:kworker.0 Request processed in 73us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526832.597456:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788526832.597489:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580672 00000100:00100000:1.0:1788526832.597493:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580672 00000100:00100000:1.0:1788526832.597529:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580544 00000100:00100000:1.0:1788526832.597532:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580544 00000100:00100000:1.0:1788526832.597546:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788526832.597551:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597583:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881580672:12345-0@lo:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526832.597590:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788526832.597602:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788526832.597607:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881580544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526832.597637:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881580544:12345-0@lo:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526832.597643:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788526832.597671:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580288 00000100:00100000:1.0:1788526832.597674:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580288 00000100:00100000:1.0:1788526832.597697:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580416 00000100:00100000:1.0:1788526832.597700:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580416 00000100:00080000:2.0:1788526832.598221:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788526832.598227:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788526832.598261:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274960a80 x1875405881580544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526832.598277:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881580544:0@lo:400:kworker.0 00000100:00100000:2.0:1788526832.598304:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881580800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788526832.598339:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788526832.598372:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274961180 x1875405881580672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526832.598382:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881580672:0@lo:400:kworker.0 00000100:00100000:2.0:1788526832.598412:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881580160:0@lo:400:kworker.0 00000100:00100000:2.0:1788526832.598449:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580800 00000100:00100000:2.0:1788526832.598466:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580800 00000100:00100000:2.0:1788526832.598503:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526832.598509:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881580800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526832.598540:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526832.598578:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881580800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526832.598584:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526832.598609:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526832.598616:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881580288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526832.598650:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881580288:12345-0@lo:400:kworker.0 Request processed in 35us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526832.598656:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788526832.598681:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788526832.598717:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881580288:0@lo:400:kworker.0 00000100:00100000:2.0:1788526832.598745:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881580800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526832.599467:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788526832.599473:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875405881580416:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788526832.599491:0:15000:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788526832.657284:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875405881580416:12345-0@lo:8:kworker.0 Request processed in 57802us (60010us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788526832.657301:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788526832.657379:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788526832.657411:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788526832.657417:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881580416:0@lo:8:kworker.0 00010000:00010000:2.0:1788526833.301434:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788526833.938107:0:15720:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:0.0:1788526833.938113:0:15720:0:(obd_mount.c:928:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788526833.938419:0:15720:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98c27fab5000 00000020:01000004:0.0:1788526833.938758:0:15720:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788526833.938771:0:15720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788526833.938832:0:15720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98c26fa09980) 00000020:00000080:0.0:1788526833.939001:0:15720:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788526833.971333:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788526833.972771:0:15720:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788526833.978967:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788526833.980160:0:15720:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788526833.983119:0:15720:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788526833.987711:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:1.0:1788526833.987926:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:1.0:1788526833.988033:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:1.0:1788526833.988773:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 649: rc = 0 00100000:10000000:1.0:1788526833.989059:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 649: rc = 0 00100000:10000000:1.0:1788526833.989312:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 649: rc = 0 00100000:10000000:1.0:1788526833.989596:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 649: rc = 0 00100000:10000000:1.0:1788526833.989859:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 649: rc = 0 00100000:10000000:1.0:1788526833.990106:0:15720:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 649: rc = 0 00000020:00000080:2.0:1788526833.997136:0:15720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788526833.997151:0:15720:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788526833.997162:0:15720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x367645d450b3b49f 00000020:01000004:2.0:1788526833.997171:0:15720:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788526833.997209:0:15720:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788526833.997213:0:15720:0:(mgc_request.c:1317:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788526833.997219:0:15720:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788526833.998503:0:15720:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788526833.998509:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788526833.998511:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526833.998512:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526833.998513:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526833.998514:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526833.999069:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526833.999071:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526833.999072:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526833.999074:0:15720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788526833.999078:0:15720:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788526833.999081:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788526833.999083:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526833.999084:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526833.999085:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526833.999086:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526833.999087:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526833.999088:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526833.999089:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526833.999090:0:15720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788526833.999130:0:15720:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788526833.999154:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881580928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788526833.999990:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.000117:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a370840 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.000428:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881580928 00000100:00100000:0.0:1788526834.000438:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881580928 00000100:00100000:0.0:1788526834.000714:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788526834.000725:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:15720:x1875405881580928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788526834.000798:0:14311:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788526834.000802:0:14311:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788526834.000806:0:14311:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788526834.019748:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:15720:x1875405881580928:12345-0@lo:253:mount.lustre.0 Request processed in 19015us (19752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.019764:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788526834.020235:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881580928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788526834.020254:0:15720:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788526834.020257:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526834.020259:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526834.020261:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526834.020262:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526834.020263:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526834.020265:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526834.020266:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526834.020268:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526834.020270:0:15720:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788526834.020294:0:15720:0:(tgt_mount.c:115:server_register_mount()) register mount ffff98c27fab5000 from lustre-OST0001 10000000:01000000:2.0:1788526834.020334:0:15720:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788526834.020338:0:15720:0:(mgc_request.c:423:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788526834.020346:0:15720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98c27fab5000 10000000:01000000:2.0:1788526834.020354:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788526834.020370:0:15720:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788526834.035179:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788526834.044174:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788526834.044195:0:15720:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-sptlrpc-ffff98c27fab5000 from 1 10000000:01000000:2.0:1788526834.044200:0:15720:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788526834.044247:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.044260:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.044272:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526834.044299:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788526834.044372:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.044447:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788526834.044872:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581056 00000100:00100000:3.0:1788526834.044881:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581056 00000100:00100000:3.0:1788526834.044942:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788526834.044952:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+17:15720:x1875405881581056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526834.044966:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526834.044980:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e6000/0x367645d450b3b4ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b4a6 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.045005:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e6000/0x367645d450b3b4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b4a6 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.045027:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e6000/0x367645d450b3b4ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b4a6 expref: 18 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.045036:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6000, rc 0) 00000100:00100000:3.0:1788526834.045088:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581056:12345-0@lo:101:mount.lustre.0 Request processed in 138us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.045094:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788526834.045249:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526834.045266:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4ad expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.045276:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b4ad expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526834.045511:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526834.045543:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.045565:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.045618:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581184 00000100:00100000:0.0:1788526834.045623:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581184 00000100:00100000:0.0:1788526834.045666:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788526834.045674:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526834.045958:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581184:12345-0@lo:501:mount.lustre.0 Request processed in 283us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526834.045966:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788526834.046163:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788526834.046180:0:15720:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788526834.046361:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526834.046434:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.046459:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250c75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526834.046695:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581312 00000100:00100000:1.0:1788526834.046700:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581312 00000100:00100000:1.0:1788526834.046751:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788526834.046759:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526834.046954:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581312:12345-0@lo:501:mount.lustre.0 Request processed in 195us (519us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526834.046961:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788526834.047283:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581312:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788526834.047435:0:15720:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788526834.047454:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4ad expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.047464:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c242c76200/0x367645d450b3b4a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4ad expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526834.047487:0:15720:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff98c27fab5000 10000000:01000000:3.0:1788526834.047494:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788526834.047513:0:15720:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788526834.047662:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788526834.047671:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788526834.047680:0:15720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788526834.047684:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788526834.047695:0:15720:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788526834.047743:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788526834.047748:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788526834.047754:0:15720:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788526834.047757:0:15720:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788526834.047796:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.047805:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.047814:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526834.047831:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788526834.047871:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526834.047906:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247f0a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.048296:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581440 00000100:00100000:2.0:1788526834.048302:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581440 00000100:00100000:2.0:1788526834.048333:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788526834.048341:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:15720:x1875405881581440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526834.048351:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526834.048364:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c76600/0x367645d450b3b4bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b4b4 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.048415:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c76600/0x367645d450b3b4bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b4b4 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.048426:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c76600/0x367645d450b3b4bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b4b4 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.048434:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76600, rc 0) 00000100:00100000:2.0:1788526834.048472:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581440:12345-0@lo:101:mount.lustre.0 Request processed in 132us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.048478:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788526834.049440:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526834.049463:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4bb expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.049497:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b4bb expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526834.051873:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788526834.054136:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526834.054470:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788526834.054518:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:3.0:1788526834.054561:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:3.0:1788526834.054626:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:3.0:1788526834.054677:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:3.0:1788526834.054714:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:3.0:1788526834.054788:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:3.0:1788526834.054828:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:3.0:1788526834.054876:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:3.0:1788526834.054938:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:3.0:1788526834.054946:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:3.0:1788526834.055070:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526834.055147:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526834.055200:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247f0ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.055428:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581568 00000100:00100000:0.0:1788526834.055437:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581568 00000100:00100000:0.0:1788526834.055488:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788526834.055498:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526834.055993:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581568:12345-0@lo:501:mount.lustre.0 Request processed in 495us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526834.056003:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788526834.056174:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526834.056241:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788526834.056290:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.056327:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551300 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.057092:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581696 00000100:00100000:0.0:1788526834.057102:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581696 00000100:00100000:0.0:1788526834.057158:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788526834.057168:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526834.060083:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581696:12345-0@lo:503:mount.lustre.0 Request processed in 2837us (3713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.060104:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526834.060241:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000040:00080000:1.0:1788526834.061495:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788526834.061600:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526834.061693:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.061748:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551300 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.063453:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581824 00000100:00100000:0.0:1788526834.063468:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581824 00000100:00100000:0.0:1788526834.063547:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788526834.063559:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788526834.064247:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581824:12345-0@lo:502:mount.lustre.0 Request processed in 688us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526834.064256:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788526834.064463:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788526834.064798:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788526834.065092:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:1.0:1788526834.065145:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:1.0:1788526834.065191:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:1.0:1788526834.065222:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:1.0:1788526834.065250:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:1.0:1788526834.065290:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:1.0:1788526834.065324:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:1.0:1788526834.065371:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:1.0:1788526834.065440:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526834.065504:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.065557:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551300 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.065851:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881581952 00000100:00100000:2.0:1788526834.065859:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881581952 00000100:00100000:2.0:1788526834.065911:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788526834.065920:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526834.066120:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881581952:12345-0@lo:502:mount.lustre.0 Request processed in 200us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.066127:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788526834.067351:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881581952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788526834.068566:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:1.0:1788526834.068586:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788526834.072633:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788526834.072714:0:15721:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788526834.072723:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.072726:0:15721:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788526834.072734:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788526834.072753:0:15721:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98c27b7ae600) 00000020:00000080:3.0:1788526834.072815:0:15721:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788526834.072824:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788526834.073169:0:15721:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c27fab5000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788526834.073180:0:15721:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788526834.073189:0:15721:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x367645d450b3b4c9 00010000:00010000:3.0:1788526834.082030:0:15721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788526834.082988:0:15721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788526834.087546:0:15721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1788526834.096222:0:15721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788526834.096238:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526834.096245:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526834.096247:0:15721:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788526834.096252:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526834.096255:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526834.096257:0:15721:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788526834.096260:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788526834.096261:0:15721:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788526834.096264:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526834.096266:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526834.096267:0:15721:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788526834.096270:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788526834.096272:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526834.096273:0:15721:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788526834.096276:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788526834.096851:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788526834.096857:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788526834.096859:0:15721:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788526834.096862:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:3.0:1788526834.097014:0:15720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788526834.097030:0:15720:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788526834.097054:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4bb expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.097067:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e6600/0x367645d450b3b4b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4bb expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526834.097075:0:15720:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27fab5000 from 1 10000000:01000000:3.0:1788526834.097078:0:15720:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526834.097136:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.097145:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.097158:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526834.097183:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788526834.097252:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526834.097307:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247f0a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.097732:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582080 00000100:00100000:0.0:1788526834.097742:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582080 00000100:00100000:0.0:1788526834.098886:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788526834.098900:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:15720:x1875405881582080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788526834.098917:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526834.098939:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b4d0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.098971:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.098985:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.098994:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821a00, rc 0) 00000100:00100000:0.0:1788526834.099144:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582080:12345-0@lo:101:mount.lustre.0 Request processed in 247us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526834.099151:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788526834.106215:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788526834.106249:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.106284:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788526834.107034:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:3.0:1788526834.107703:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788526834.108074:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788526834.108125:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:3.0:1788526834.108207:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:3.0:1788526834.108249:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:3.0:1788526834.108291:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:3.0:1788526834.108344:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:3.0:1788526834.108384:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:3.0:1788526834.108451:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:3.0:1788526834.108521:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788526834.108530:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:3.0:1788526834.108625:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788526834.108699:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526834.108754:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c247f0a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.109007:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582208 00000100:00100000:2.0:1788526834.109025:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582208 00000100:00100000:2.0:1788526834.109082:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788526834.109092:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526834.109461:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582208:12345-0@lo:501:mount.lustre.0 Request processed in 369us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.109470:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788526834.112596:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788526834.112677:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788526834.112754:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526834.112805:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2464026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526834.113148:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582336 00000100:00100000:3.0:1788526834.113157:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582336 00000100:00100000:3.0:1788526834.113217:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788526834.113227:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788526834.116184:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582336:12345-0@lo:503:mount.lustre.0 Request processed in 2948us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.116199:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788526834.116469:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788526834.117512:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788526834.118043:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788526834.118133:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526834.118184:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2464026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526834.118272:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582464 00000100:00100000:1.0:1788526834.118279:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582464 00000100:00100000:1.0:1788526834.118326:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788526834.118336:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526834.118869:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582464:12345-0@lo:502:mount.lustre.0 Request processed in 533us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.118877:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788526834.119307:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788526834.119977:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788526834.120071:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:3.0:1788526834.120138:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:3.0:1788526834.120178:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:3.0:1788526834.120213:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:3.0:1788526834.120262:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:3.0:1788526834.120298:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:3.0:1788526834.120333:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000100:00100000:3.0:1788526834.120378:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788526834.120906:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526834.120979:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27f5a8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788526834.125105:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582592 00000100:00100000:0.0:1788526834.125119:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582592 00000100:00100000:1.0:1788526834.126046:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788526834.126060:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788526834.126349:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582592:12345-0@lo:502:mount.lustre.0 Request processed in 293us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.126357:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788526834.126499:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788526834.126697:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788526834.126716:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788526834.128316:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526834.128330:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128333:0:15725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788526834.128339:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27fab5000 00000020:00000080:3.0:1788526834.128341:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526834.128348:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526834.128350:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128351:0:15725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788526834.128354:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526834.128356:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128357:0:15725:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788526834.128361:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98c27fab5000 00000020:00000080:3.0:1788526834.128363:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526834.128448:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526834.128452:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128454:0:15725:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788526834.128456:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788526834.128458:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128460:0:15725:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788526834.128470:0:15725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98c27fab5000 00000020:00000080:3.0:1788526834.128472:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788526834.128520:0:15725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788526834.128524:0:15725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788526834.128525:0:15725:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788526834.128528:0:15725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000020:01000000:0.0:1788526834.132932:0:15720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788526834.132958:0:15720:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788526834.132976:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.132989:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788526834.133053:0:15720:0:(mgc_request.c:2207:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788526834.133057:0:15720:0:(mgc_request.c:423:config_log_add()) add config log lustre-client-ffff98c27fab5000 10000000:01000000:0.0:1788526834.133060:0:15720:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff98c27fab5000 10000000:01000000:0.0:1788526834.133066:0:15720:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788526834.133083:0:15720:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.204.159@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788526834.133178:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788526834.133187:0:15720:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788526834.133202:0:15720:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-client-ffff98c27fab5000 from 1 10000000:01000000:0.0:1788526834.133205:0:15720:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788526834.133264:0:15720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.133274:0:15720:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.133286:0:15720:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526834.133315:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788526834.133423:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526834.133463:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b9ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.133805:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582720 00000100:00100000:2.0:1788526834.133816:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582720 00000100:00100000:2.0:1788526834.133876:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788526834.133886:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881582720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526834.133909:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526834.133925:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c242c76e00/0x367645d450b3b4e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b4de expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.133948:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c242c76e00/0x367645d450b3b4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b4de expref: 21 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.133958:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c242c76e00/0x367645d450b3b4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b4de expref: 21 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.133967:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242c76e00, rc 0) 00000100:00100000:2.0:1788526834.134020:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881582720:12345-0@lo:101:mount.lustre.0 Request processed in 134us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.134027:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788526834.136687:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788526834.136718:0:15720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4e5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.136755:0:15720:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b4e5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526834.137459:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 42 count 42 00000040:00080000:2.0:1788526834.137889:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526834.138160:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788526834.138203:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:2.0:1788526834.138236:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:2.0:1788526834.138278:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:2.0:1788526834.138310:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:2.0:1788526834.138353:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:2.0:1788526834.138412:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:2.0:1788526834.138447:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:2.0:1788526834.138507:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:2.0:1788526834.138541:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:2.0:1788526834.138574:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:2.0:1788526834.138623:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:2.0:1788526834.138658:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:2.0:1788526834.138690:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:2.0:1788526834.138737:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:2.0:1788526834.138773:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:2.0:1788526834.138823:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:2.0:1788526834.138870:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:2.0:1788526834.138907:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:2.0:1788526834.138943:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:2.0:1788526834.138997:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:2.0:1788526834.139031:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:2.0:1788526834.139064:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:2.0:1788526834.139112:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:2.0:1788526834.139165:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 128 off12440 00000040:00080000:2.0:1788526834.139210:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12664 00000040:00080000:2.0:1788526834.139260:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12888 00000040:00080000:2.0:1788526834.139296:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off12968 00000040:00080000:2.0:1788526834.139327:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13192 00000040:00080000:2.0:1788526834.139370:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13416 00000040:00080000:2.0:1788526834.139432:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13504 00000040:00080000:2.0:1788526834.144315:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13632 00000040:00080000:2.0:1788526834.144375:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13776 00000040:00080000:2.0:1788526834.146697:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13904 00000040:00080000:2.0:1788526834.146765:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14128 00000040:00080000:2.0:1788526834.146836:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14352 00000040:00080000:2.0:1788526834.146872:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14432 00000040:00080000:2.0:1788526834.146902:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14656 00000040:00080000:2.0:1788526834.146951:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14880 00000040:00080000:2.0:1788526834.146989:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 120 off15000 00000040:00080000:2.0:1788526834.148863:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 224 off15224 00000040:00080000:2.0:1788526834.148891:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 41 count 42 00000100:00100000:2.0:1788526834.148995:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526834.149077:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.149120:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a370840 going to sleep for 11 seconds 00000100:00100000:1.0:1788526834.152147:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582848 00000100:00100000:1.0:1788526834.152167:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582848 00000100:00100000:1.0:1788526834.152244:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788526834.152257:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881582848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788526834.152629:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881582848:12345-0@lo:501:mount.lustre.0 Request processed in 373us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.152638:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788526834.154327:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788526834.154419:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526834.154519:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.154577:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881582976 00000100:00100000:2.0:1788526834.154592:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881582976 00000100:00100000:2.0:1788526834.154640:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788526834.154649:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881582976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788526834.155024:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881582976:12345-0@lo:503:mount.lustre.0 Request processed in 375us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.155044:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788526834.155102:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a370840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.155116:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881582976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788526834.155787:0:15720:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526834.155866:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881583104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526834.155921:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.155958:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583104 00000100:00100000:2.0:1788526834.155963:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583104 00000100:00100000:2.0:1788526834.155998:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788526834.156006:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881583104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526834.156267:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881583104:12345-0@lo:502:mount.lustre.0 Request processed in 260us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.156274:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788526834.156325:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.156341:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881583104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788526834.156586:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788526834.156635:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:2.0:1788526834.156668:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:2.0:1788526834.156714:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:2.0:1788526834.156748:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:2.0:1788526834.156806:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:2.0:1788526834.156842:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:2.0:1788526834.156872:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:2.0:1788526834.156927:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:2.0:1788526834.156963:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:2.0:1788526834.156995:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:2.0:1788526834.157042:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:2.0:1788526834.158794:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:2.0:1788526834.158850:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:2.0:1788526834.158918:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:2.0:1788526834.158952:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:2.0:1788526834.158979:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:2.0:1788526834.159097:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:2.0:1788526834.159132:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:2.0:1788526834.159160:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:2.0:1788526834.159201:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:2.0:1788526834.159233:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:2.0:1788526834.159260:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:2.0:1788526834.159299:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:2.0:1788526834.159329:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 128 off12440 00000040:00080000:2.0:1788526834.159356:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12664 00000040:00080000:2.0:1788526834.159477:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12888 00000040:00080000:2.0:1788526834.159711:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off12968 00000040:00080000:2.0:1788526834.159761:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13192 00000040:00080000:2.0:1788526834.159826:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13416 00000040:00080000:2.0:1788526834.159862:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13504 00000040:00080000:2.0:1788526834.159894:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13632 00000040:00080000:2.0:1788526834.159925:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13776 00000040:00080000:2.0:1788526834.159971:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13904 00000040:00080000:2.0:1788526834.160004:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14128 00000040:00080000:2.0:1788526834.160125:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14352 00000040:00080000:2.0:1788526834.160161:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14432 00000040:00080000:2.0:1788526834.160195:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14656 00000040:00080000:2.0:1788526834.160244:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14880 00000040:00080000:2.0:1788526834.160281:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 120 off15000 00000100:00100000:2.0:1788526834.160337:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881583232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788526834.160712:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.160821:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526834.160874:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583232 00000100:00100000:3.0:1788526834.160881:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583232 00000100:00100000:3.0:1788526834.160967:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788526834.160978:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881583232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788526834.161723:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881583232:12345-0@lo:502:mount.lustre.0 Request processed in 743us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.161733:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788526834.161927:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881583232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788526834.162049:0:15720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 224 off15224 00000040:00080000:2.0:1788526834.162063:0:15720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788526834.165945:0:15730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788526834.165966:0:15730:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98c27b1f3300) 00000020:00000080:2.0:1788526834.165991:0:15730:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788526834.166247:0:15730:0:(tgt_mount.c:167:server_get_mount()) get mount ffff98c27fab5000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788526834.166252:0:15730:0:(tgt_mount.c:201:server_put_mount()) put mount ffff98c27fab5000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788526834.166255:0:15730:0:(obd_mount.c:712:lustre_put_lsi()) put ffff98c27fab5000 3 00010000:00080000:2.0:1788526834.166286:0:15730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98c27b9cf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1788526834.174357:0:15730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788526834.175213:0:15730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788526834.175254:0:15730:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788526834.175270:0:15730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x367645d450b3b4f3 00000100:00080000:2.0:1788526834.175283:0:15730:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788526834.175290:0:15730:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98c27b9cf000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1788526834.175332:0:15730:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274b48e00 x1875405881583360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788526834.176332:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881583360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788526834.176447:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.178923:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583360 00000100:00100000:1.0:1788526834.178940:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583360 00000100:00100000:1.0:1788526834.179004:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788526834.179021:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3277:x1875405881583360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788526834.179051:0:14317:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788526834.179091:0:14317:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x367645d450b3b4fa 00000004:00100000:1.0:1788526834.179110:0:14317:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788526834.179148:0:14317:0:(import.c:65:import_set_state_nolock()) ffff98c281ea6000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788526834.179290:0:15730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788526834.179922:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788526834.179927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788526834.179929:0:36:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788526834.179931:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875405881583360:12345-0@lo:38:llog_process_th.0 Request processed in 908us (3482us total) trans 0 rc 0/0 00000100:00080000:3.0:1788526834.179934:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1788526834.179938:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788526834.179943:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1788526834.179950:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788526834.179962:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274779180 x1875405881583616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788526834.179973:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526834.179986:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881583744:0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.180044:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.180071:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881583488:0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.180094:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526834.180127:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583744 00000100:00100000:1.0:1788526834.180131:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583744 00000100:00100000:1.0:1788526834.180159:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788526834.180165:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881583744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.180199:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881583744:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.180206:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788526834.180223:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583488 00000100:00100000:1.0:1788526834.180226:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583488 00000100:00100000:1.0:1788526834.180258:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788526834.180264:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881583488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.180291:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881583488:12345-0@lo:400:kworker.0 Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.180297:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788526834.180312:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788526834.180340:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c27477bb80 x1875405881583744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526834.180352:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881583744:0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.180363:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881583488:0@lo:400:kworker.0 00000100:00100000:2.0:1788526834.181347:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788526834.181366:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881583872:0@lo:400:kworker.0 00000100:00100000:2.0:1788526834.181432:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788526834.184995:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274b48e00 x1875405881583360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788526844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788526834.185012:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788526834.185026:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788526834.185037:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788526834.185043:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788526834.185047:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27b9cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788526834.185056:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3277:1875405881583360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788526834.186234:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881583616:0@lo:8:kworker.0 00000100:00100000:0.0:1788526834.186311:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788526834.186823:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 42 count 42 00000020:01000000:2.0:1788526834.187806:0:15720:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788526834.187823:0:15720:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788526834.187846:0:15720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4e5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.187857:0:15720:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c26e821400/0x367645d450b3b4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b4e5 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788526834.187927:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788526834.187929:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526834.187931:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526834.187932:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526834.187933:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526834.187935:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526834.187937:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526834.187939:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526834.187940:0:15720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526834.187944:0:15720:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788526834.187947:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788526834.187948:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526834.187949:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526834.187950:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526834.187951:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526834.187952:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526834.187953:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526834.187954:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526834.187955:0:15720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788526834.187983:0:15720:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788526834.188004:0:15720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881584000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788526834.188080:0:15720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.188115:0:15720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b77ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.188137:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584000 00000100:00100000:2.0:1788526834.188144:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584000 00000100:00100000:1.0:1788526834.188244:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583616 00000100:00100000:1.0:1788526834.188250:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583616 00000100:00100000:1.0:1788526834.188291:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526834.188299:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875405881583616:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788526834.188321:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788526834.188330:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:15720:x1875405881584000:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788526834.188372:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3277:x1875405881583616:12345-0@lo:8:kworker.0 Request processed in 72us (2061us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788526834.188380:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526834.188448:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788526834.188457:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788526834.188460:0:3277:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788526834.188464:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881583616:0@lo:8:kworker.0 00000100:00100000:1.0:1788526834.188522:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881583872 00000100:00100000:1.0:1788526834.188527:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881583872 00000100:00100000:1.0:1788526834.188562:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788526834.188570:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881583872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526834.188629:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875405881583872:12345-0@lo:400:kworker.0 Request processed in 60us (7197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526834.188635:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788526834.188668:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98c274778700 x1875405881583872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788526834.188679:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3281:1875405881583872:0@lo:400:kworker.0 00000100:00080000:1.0:1788526834.188695:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788526834.188830:0:14308:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788526834.188846:0:14308:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788526834.231887:0:14308:0:(mgs_nids.c:820:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788526834.231910:0:14308:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788526834.233147:0:14332:0:(mgs_nids.c:717:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788526834.233156:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788526834.233181:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.233200:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b3bf expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.233209:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.233251:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526834.233268:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 21 pid: 14311 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526834.233302:0:14332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881584128:0@lo:104: 00000100:00100000:0.0:1788526834.233370:0:14332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526834.233595:0:14332:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2490f9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788526834.233723:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584128 00000100:00100000:2.0:1788526834.233732:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584128 00000100:00100000:2.0:1788526834.233793:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526834.233805:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881584128:12345-0@lo:104: 00010000:00010000:2.0:1788526834.233825:0:14299:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.233885:0:14299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788526834.233891:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:14332:x1875405881584128:12345-0@lo:104: Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526834.233898:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788526834.233922:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526834.233928:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.233936:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:2.0:1788526834.233941:0:14304:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.233950:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788526834.233957:0:14304:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526834.233963:0:14304:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788526834.234001:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.234009:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526834.234031:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.234038:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c245111600/0x367645d450b3b3bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b3c6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.234070:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526834.234072:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526834.234074:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526834.234084:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788526834.234098:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881584256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788526834.234133:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526834.234187:0:14332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14332:1875405881584128:0@lo:104: 00010000:00010000:2.0:1788526834.234211:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526834.234321:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584256 00000100:00100000:3.0:1788526834.234326:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584256 00010000:00010000:3.0:1788526834.234344:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 22 pid: 14311 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526834.234368:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788526834.234380:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+22:3280:x1875405881584256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526834.234406:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526834.234412:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 22 pid: 14311 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234421:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 22 pid: 14311 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234434:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b3c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b3bf expref: 22 pid: 14311 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234445:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234452:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788526834.234464:0:14301:0:(mgs_nids.c:693:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009419535s 00010000:00010000:3.0:1788526834.234468:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234474:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234480:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234485:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234490:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526834.234499:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234508:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234530:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526834.234540:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526834.234572:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881584256:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.234578:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526834.234997:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881584256:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788526834.235030:0:14332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.235038:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526834.235044:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821000/0x367645d450b3b501 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526834.246204:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:15720:x1875405881584000:12345-0@lo:253:mount.lustre.0 Request processed in 57856us (58104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526834.246223:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788526834.246458:0:15720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25a41ce-5827-423c-b0c5-e955955f4e9e:15720:1875405881584000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788526834.246475:0:15720:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788526834.246479:0:15720:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788526834.246481:0:15720:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788526834.246482:0:15720:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788526834.246483:0:15720:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788526834.246484:0:15720:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788526834.246493:0:15720:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788526834.246511:0:15720:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788526834.246513:0:15720:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788526834.246515:0:15720:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788526834.246535:0:15720:0:(tgt_mount.c:2815:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788526834.257937:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526834.258113:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526834.258302:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526834.258470:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788526834.258619:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788526834.258842:0:15720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788526834.262945:0:15720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788526834.323934:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788526834.359153:0:15720:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788526834.359162:0:15720:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788526834.359210:0:15720:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788526834.359241:0:15720:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788526835.347743:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788526835.800277:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788526836.179552:0:14313:0:(mgc_request.c:714:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788526836.179559:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log lustre-mdtir-ffff98c244e62800 from 8 10000000:01000000:3.0:1788526836.179565:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788526836.179627:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526836.179664:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526836.179677:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526836.179704:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881584384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788526836.179794:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526836.179852:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526836.179989:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584384 00000100:00100000:1.0:1788526836.179998:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584384 00000100:00100000:1.0:1788526836.180055:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788526836.180073:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881584384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526836.180104:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526836.180125:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c245110a00/0x367645d450b3b50f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b508 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526836.180151:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c245110a00/0x367645d450b3b50f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b508 expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526836.180163:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c245110a00/0x367645d450b3b50f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b508 expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526836.180172:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110a00, rc 0) 00000100:00100000:1.0:1788526836.180227:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881584384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526836.180234:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788526836.180542:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881584384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526836.180558:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b50f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526836.180568:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b50f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526836.180645:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881584512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788526836.180856:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526836.180889:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c245236b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788526836.180941:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584512 00000100:00100000:0.0:1788526836.180947:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584512 00000100:00100000:0.0:1788526836.180984:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788526836.180991:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881584512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788526836.181007:0:14308:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788526836.181027:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788526836.181030:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788526836.181128:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881584512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526836.181135:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788526836.182234:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881584512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788526836.182317:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788526836.182327:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b50f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526836.182338:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e6e00/0x367645d450b3b508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b50f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526836.379126:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526837.395588:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526837.715738:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526837.715764:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881584640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526837.715978:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526837.716291:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584640 00000100:00100000:2.0:1788526837.716300:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584640 00000100:00100000:2.0:1788526837.716361:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526837.716370:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881584640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526837.716437:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526837.716485:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881584640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526837.716493:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788526837.716543:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881584640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788526837.716802:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788526838.422668:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526839.253151:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881584768:0@lo:400:kworker.0 00000100:00100000:1.0:1788526839.253233:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788526839.253347:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788526839.253351:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788526839.253355:0:37:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788526839.253365:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98c27f588000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1788526839.253408:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98c274b4aa00 x1875405881585024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788526839.257715:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881584896:0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.257804:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526839.260570:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526839.260590:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881585152:0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.260670:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526839.260757:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881585280:0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.260854:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526839.260903:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584896 00000100:00100000:3.0:1788526839.260913:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584896 00000100:00100000:3.0:1788526839.260978:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526839.260989:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881584896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.261057:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881584896:12345-0@lo:400:kworker.0 Request processed in 70us (3253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526839.261064:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788526839.261300:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585152 00000100:00100000:3.0:1788526839.261304:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585152 00000100:00100000:3.0:1788526839.261334:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585280 00000100:00100000:3.0:1788526839.261338:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585280 00000100:00100000:3.0:1788526839.261355:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526839.261361:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881585152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.261526:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881585152:12345-0@lo:400:kworker.0 Request processed in 164us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526839.261532:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526839.261545:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788526839.261551:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881585280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.261593:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881585280:12345-0@lo:400:kworker.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526839.261599:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788526839.261618:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526839.261623:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788526839.261653:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c274b48000 x1875405881585152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526839.261667:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881585152:0@lo:400:kworker.0 00000100:00100000:3.0:1788526839.261955:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881584896:0@lo:400:kworker.0 00010000:00080000:3.0:1788526839.262002:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c274b4b800 x1875405881585280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788526839.262012:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881585280:0@lo:400:kworker.0 00000100:00100000:1.0:1788526839.263837:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881584768 00000100:00100000:1.0:1788526839.263852:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881584768 00000100:00100000:1.0:1788526839.263978:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788526839.263990:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3279:x1875405881584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526839.264078:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3279:x1875405881584768:12345-0@lo:400:kworker.0 Request processed in 92us (10845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526839.264086:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788526839.264149:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881585024:0@lo:8:kworker.0 00000100:00100000:1.0:1788526839.264319:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526839.264630:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585024 00000100:00100000:1.0:1788526839.264636:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585024 00000100:00100000:1.0:1788526839.264661:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788526839.264667:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3277:x1875405881585024:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788526839.264706:0:15002:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1788526839.264736:0:15002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x367645d450b3b516 00002000:00100000:1.0:1788526839.264749:0:15002:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98c281ea0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788526839.264753:0:15002:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788526839.264755:0:15002:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788526839.266057:0:15002:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788526839.266090:0:15002:0:(import.c:65:import_set_state_nolock()) ffff98c281ea4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526839.266303:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875405881585024:12345-0@lo:8:kworker.0 Request processed in 1634us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526839.266312:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526839.267676:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526839.267707:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881585408:0@lo:400:kworker.0 00000100:00100000:1.0:1788526839.268638:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881584768:0@lo:400:kworker.0 00010000:00080000:3.0:1788526839.268841:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c274b4aa00 x1875405881585024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788526864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788526839.268861:0:3277:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788526839.268869:0:3277:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788526839.268878:0:3277:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788526839.268881:0:3277:0:(import.c:65:import_set_state_nolock()) ffff98c27f588000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788526839.268975:0:3277:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788526839.268983:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3277:1875405881585024:0@lo:8:kworker.0 00000004:00080000:1.0:1788526839.269099:0:14341:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788526839.269119:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1875405881585664:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788526839.269311:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881585536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526839.269737:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526839.269781:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788526839.269811:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585664 00000100:00100000:1.0:1788526839.269818:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585664 00000100:00100000:1.0:1788526839.269873:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788526839.269883:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14341:x1875405881585664:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788526839.273999:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788526839.275729:0:15000:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788526839.275747:0:15000:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788526839.275753:0:15000:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000004:00080000:3.0:1788526839.275960:0:14340:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788526839.278346:0:14340:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 474618956748ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788526839.279705:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585536 00000100:00100000:2.0:1788526839.279721:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585536 00000100:00100000:2.0:1788526839.279781:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526839.279802:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881585536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526839.279920:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526839.280077:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875405881585536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 277us (10727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526839.280084:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788526839.280143:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c274962300 x1875405881585536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788526855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526839.280166:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881585536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526839.280217:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526839.280245:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585408 00000100:00100000:2.0:1788526839.280249:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585408 00000100:00100000:2.0:1788526839.280282:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526839.280289:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881585408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526839.281457:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881585408:12345-0@lo:400:kworker.0 Request processed in 1163us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526839.281467:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788526839.281531:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98c274b49f80 x1875405881585408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788526855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788526839.281546:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881585408:0@lo:400:kworker.0 00000100:00080000:1.0:1788526839.297265:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788526839.297274:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788526839.303081:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.303095:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303114:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.303119:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.303127:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303149:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303160:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303168:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303189:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.303259:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.303265:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303273:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.303285:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303294:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303311:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303319:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b51d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.303337:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.303340:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.303341:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788526839.312246:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.312264:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312284:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.312289:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.312298:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312312:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312323:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312340:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312361:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.312377:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.312401:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312410:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.312416:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312425:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312444:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312452:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b524 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.312469:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.312471:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.312473:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788526839.316786:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.316811:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316828:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.316833:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.316839:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316854:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316866:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316875:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316893:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.316906:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.316913:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.316921:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.318058:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318076:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318105:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318115:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695b28eb/0x367645d450b3b52b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318143:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.318145:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.318147:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788526839.318846:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.318854:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318866:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.318870:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.318876:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318888:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318897:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.318906:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319576:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.319595:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.319602:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319612:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.319617:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319628:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319648:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319657:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b532 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.319695:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.319698:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.319701:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788526839.321642:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.321656:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321674:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.321701:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.321708:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321724:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321737:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321745:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321764:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.321777:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.321783:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321791:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.321796:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321804:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321821:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321842:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.321863:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.321865:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.321867:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788526839.326986:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788526839.327002:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327022:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788526839.327028:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526839.327035:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327052:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327063:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327071:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327092:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.327108:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.327119:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327128:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.327135:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327147:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327165:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327173:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b540 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.327602:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.327605:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.327607:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526839.333792:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526839.333807:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.333825:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788526839.333829:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526839.333835:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.333850:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.333860:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.333875:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.333891:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.334337:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.334345:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.334356:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.334361:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.334411:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.334433:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.334441:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c5cea4e/0x367645d450b3b547 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.334457:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.334459:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.334461:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526839.335740:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526839.335754:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.335770:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788526839.335775:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526839.335782:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.335795:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.335805:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.335813:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.335832:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.336509:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.336519:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.336529:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.336537:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.336546:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.336566:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.336586:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006099947c/0x367645d450b3b54e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.336606:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.336608:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.336610:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526839.337012:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526839.337020:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337038:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788526839.337042:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526839.337048:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337059:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337068:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337074:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337132:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788526839.337755:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788526839.337762:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337772:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788526839.337775:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526839.337780:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337790:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337810:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.337818:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788526839.338216:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788526839.338576:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526839.338585:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338596:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.338601:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338610:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338627:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338634:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005334f2b8/0x367645d450b3b555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338651:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.338654:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338688:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.338692:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338902:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.338916:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.339002:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.339005:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.339007:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.339098:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788526839.339105:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084ff58a2/0x367645d450b3b55c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.339619:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.339814:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.339834:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.339849:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.339860:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.339867:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.339882:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.339891:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.339900:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.339922:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.340020:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.340027:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340034:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.340039:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340047:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340061:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340077:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f43e6d39/0x367645d450b3b563 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340095:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.340099:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.340101:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.340359:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.340366:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.340375:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.340379:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.340383:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.340425:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.340434:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.340447:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.340487:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.340514:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.340521:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340531:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.340534:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340543:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340555:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340564:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b824a67d/0x367645d450b3b56a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.340578:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.340580:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.340581:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.341244:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.341252:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.341325:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.341330:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.341334:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.341345:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.341354:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.341361:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.341436:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.341443:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.341452:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.341455:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.341464:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.341476:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.341485:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.341487:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.341488:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.341492:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526839.341498:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2869890/0x367645d450b3b571 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788526839.342307:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.342317:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.342417:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.342421:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.342428:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.342439:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.342449:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.342456:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.342474:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788526839.344046:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.344058:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.344070:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.344075:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.344085:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.344119:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.344128:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001879737b/0x367645d450b3b578 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.344146:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.344148:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.344150:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.346897:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.346912:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.346931:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.346935:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.346956:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.346971:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.346981:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.346989:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.347014:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788526839.347949:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.347958:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.347970:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.347973:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.347979:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.347990:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.347998:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.348016:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.348035:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788526839.348209:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788526839.348218:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348228:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.348233:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348243:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348261:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348269:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2b8b00/0x367645d450b3b57f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348299:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.348302:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348309:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.348313:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348321:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348331:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348337:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095ae58d5/0x367645d450b3b586 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.348349:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.348350:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.348353:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.349027:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.349036:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349049:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.349053:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526839.349055:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.349059:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349073:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349082:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349090:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349116:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788526839.349158:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526839.349165:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.349175:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526839.349179:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.349189:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.349205:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.349228:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8de60c7/0x367645d450b3b58d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.349245:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.349247:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.349249:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.349761:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.349768:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349782:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.349785:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.349800:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349810:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349820:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349827:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349845:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788526839.349854:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526839.349858:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349866:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c76400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526839.349869:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349877:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349902:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349910:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c61c764/0x367645d450b3b594 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.349923:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.349925:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.349927:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.351127:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.351140:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351154:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.351159:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.351165:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351176:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351186:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351195:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351232:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788526839.351700:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.351707:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351716:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.351719:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.351723:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351732:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351740:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351747:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351764:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788526839.351776:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788526839.351782:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351942:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526839.351952:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351961:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351977:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.351985:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3089f62/0x367645d450b3b59b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352003:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526839.352007:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352014:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c800 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526839.352017:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352025:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352033:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352040:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dbccaa8/0x367645d450b3b5a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.352058:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.352060:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.352062:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.353085:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.353544:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.353553:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.353567:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.353570:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.353576:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.353588:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.353598:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.353606:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.353674:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788526839.354092:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.354098:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.354119:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.354122:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.354126:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.354136:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.354143:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.354149:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354247:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788526839.354255:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354263:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216d200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526839.354267:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354276:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354295:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354303:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fd121f1/0x367645d450b3b5a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354322:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526839.354325:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354332:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216cc00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526839.354335:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354342:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354364:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.354372:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.354374:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.354375:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.354444:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788526839.354449:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c5a2463/0x367645d450b3b5b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.354479:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788526839.354969:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.354976:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.354986:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.354989:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.354994:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355016:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355025:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355034:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355086:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788526839.355520:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.355526:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355535:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.355538:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.355543:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355551:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355560:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.355578:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355633:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788526839.355640:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355647:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216de00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526839.355650:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355658:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355671:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355688:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b19f8a/0x367645d450b3b5b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355702:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526839.355705:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355720:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c28216c200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526839.355723:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355731:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355741:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.355749:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.355750:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.355752:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.355904:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788526839.355909:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4b6d6c/0x367645d450b3b5be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788526839.356317:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.356324:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.356332:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.356336:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.356340:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.356350:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.356358:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.356365:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.356441:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788526839.356447:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.356454:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526839.356462:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.356469:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.356480:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526839.356488:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.356490:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526839.356491:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.356607:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788526839.356612:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a740196e/0x367645d450b3b5c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788526839.357147:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788526839.357154:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.357164:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788526839.357167:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526839.357172:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.357181:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.357189:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526839.357196:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.357230:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526839.357236:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.357243:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526839.357247:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.357254:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.357265:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.357279:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.357281:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.357283:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526839.360029:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788526839.360043:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042ada8b1/0x367645d450b3b5cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788526839.362183:0:15000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788526839.362196:0:15000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.362213:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=474s v=(0 0) 00010000:00010000:3.0:1788526839.362219:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526839.362225:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.362240:0:15000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.362250:0:15000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526839.362259:0:15000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.362513:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788526839.362521:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.362531:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526839.362536:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.362546:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.362565:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526839.362574:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.362576:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526839.362578:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526839.363890:0:15000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788526839.363901:0:15000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b46379/0x367645d450b3b5d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788526839.364248:0:15000:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788526839.364364:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14341:x1875405881585664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 94479us (94662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526839.364374:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788526839.364657:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1875405881585664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788526839.364688:0:14341:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788526839.364737:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1875405881585792:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788526839.364775:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526839.365103:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b551a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788526839.365172:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526839.365342:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585792 00000100:00100000:3.0:1788526839.365349:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585792 00000100:00100000:3.0:1788526839.365423:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788526839.365434:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14341:x1875405881585792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788526839.365476:0:15003:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788526839.378059:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14341:x1875405881585792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12618us (13274us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788526839.378071:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788526839.378470:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274963100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14341:1875405881585792:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788526839.378489:0:14341:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788526839.448887:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526839.857957:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788526839.858023:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788526840.468427:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788526841.454889:0:16077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788526841.492662:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788526842.515823:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526842.836601:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526842.836638:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881585920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788526842.836727:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526842.836893:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881585920 00000100:00100000:2.0:1788526842.836903:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881585920 00000100:00100000:2.0:1788526842.836976:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526842.836986:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881585920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526842.837025:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526842.837073:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881585920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526842.837080:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788526842.837139:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881585920:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788526842.837327:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788526843.539633:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526843.804626:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526843.804813:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000192 00000100:00100000:2.0:1788526843.804829:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000192 00000100:00100000:2.0:1788526843.804895:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1788526843.804905:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1875405869000192:12345-192.168.204.59@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788526843.804946:0:14310:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 2447d4eb-66e0-4350-ab08-0b300bd12120@192.168.204.59@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:2.0:1788526843.804989:0:14310:0:(genops.c:1385:class_connect()) connect: client 2447d4eb-66e0-4350-ab08-0b300bd12120, cookie 0x367645d450b3b5da 00000100:00080000:2.0:1788526843.807340:0:14310:0:(import.c:65:import_set_state_nolock()) ffff98c275417800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526843.808331:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+5:2347:x1875405869000192:12345-192.168.204.59@tcp:250:mount.lustre.0 Request processed in 2579us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526843.808346:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1788526843.826760:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526843.827269:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000320 00000100:00100000:1.0:1788526843.827287:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000320 00000100:00100000:1.0:1788526843.827379:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1788526843.827647:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+5:13750:x1875405869000320:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788526843.827674:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526843.827713:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c245110200/0x367645d450b3b5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59794 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526843.827769:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c245110200/0x367645d450b3b5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59794 expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526843.827784:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c245110200/0x367645d450b3b5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59794 expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526843.827795:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245110200, rc 0) 00000100:00100000:1.0:1788526843.827889:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+6:13750:x1875405869000320:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 249us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526843.827896:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:2.0:1788526843.840480:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526843.840640:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000448 00000100:00100000:0.0:1788526843.840654:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000448 00000100:00100000:0.0:1788526843.840875:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:0.0:1788526843.840888:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+6:13750:x1875405869000448:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788526843.841559:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+6:13750:x1875405869000448:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 669us (1089us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788526843.841570:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:1.0:1788526843.852767:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526843.868370:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000576 00000100:00100000:3.0:1788526843.868414:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000576 00000100:00100000:3.0:1788526843.868575:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:3.0:1788526843.868605:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+6:13750:x1875405869000576:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788526843.868629:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526843.868656:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b5e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5979b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526843.868699:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5979b expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526843.869782:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7c00/0x367645d450b3b5e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5979b expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526843.869822:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7c00, rc 0) 00000100:00100000:3.0:1788526843.869912:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+7:13750:x1875405869000576:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 1327us (17210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526843.869920:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1788526843.890923:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526843.890985:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000704 00000100:00100000:2.0:1788526843.891007:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000704 00000100:00100000:2.0:1788526843.891089:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:2.0:1788526843.891101:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+7:13750:x1875405869000704:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788526843.891805:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13750:x1875405869000704:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 700us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526843.891817:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:2.0:1788526843.894218:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526843.895216:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000832 00000100:00100000:3.0:1788526843.895232:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000832 00000100:00100000:3.0:1788526843.895381:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1788526843.895408:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13750:x1875405869000832:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788526843.897735:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13750:x1875405869000832:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 2318us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526843.897752:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:2.0:1788526843.913580:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526843.913801:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869000960 00000100:00100000:0.0:1788526843.913815:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869000960 00000100:00100000:0.0:1788526843.913889:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1788526843.913901:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13769:x1875405869000960:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526843.914382:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13769:x1875405869000960:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 481us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526843.914421:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1788526843.955804:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526843.959153:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001088 00000100:00100000:3.0:1788526843.959183:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001088 00000100:00100000:3.0:1788526843.959281:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1788526843.959295:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13769:x1875405869001088:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788526843.959786:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13769:x1875405869001088:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 493us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526843.959795:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1788526843.974509:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526843.974647:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001216 00000100:00100000:0.0:1788526843.974663:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001216 00000100:00100000:0.0:1788526843.974743:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:0.0:1788526843.974780:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+8:13750:x1875405869001216:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526843.974806:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526843.974832:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e820200/0x367645d450b3b5ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc597c5 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526843.974872:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e820200/0x367645d450b3b5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597c5 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526843.974887:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e820200/0x367645d450b3b5ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597c5 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526843.974898:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820200, rc 0) 00000100:00100000:0.0:1788526843.974986:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+9:13750:x1875405869001216:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 209us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526843.974993:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:1.0:1788526843.983494:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526843.983638:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001344 00000100:00100000:2.0:1788526843.983653:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001344 00000100:00100000:2.0:1788526843.983730:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:2.0:1788526843.983744:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+9:13750:x1875405869001344:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788526843.983781:0:14311:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788526843.983815:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788526843.983820:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788526843.983824:0:14311:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788526843.983827:0:14311:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788526843.998734:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+9:13750:x1875405869001344:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 14974us (15240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526843.998754:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1788526844.008328:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526844.008606:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001472 00000100:00100000:2.0:1788526844.008621:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001472 00000100:00100000:2.0:1788526844.008709:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:2.0:1788526844.008722:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+9:13750:x1875405869001472:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788526844.008745:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526844.008771:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc597cc expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526844.008809:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526844.008848:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 10 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526844.008860:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8600, rc 0) 00000100:00100000:2.0:1788526844.008950:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13750:x1875405869001472:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 230us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.008958:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1788526844.019440:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.020262:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001600 00000100:00100000:3.0:1788526844.020297:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001600 00000100:00100000:3.0:1788526844.020373:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1788526844.020410:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13750:x1875405869001600:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788526844.021028:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13750:x1875405869001600:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 642us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.021039:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1788526844.023345:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526844.025188:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001728 00000100:00100000:0.0:1788526844.025210:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001728 00000100:00100000:0.0:1788526844.025308:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:0.0:1788526844.025322:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13750:x1875405869001728:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788526844.025884:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13750:x1875405869001728:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 563us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526844.025895:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:0.0:1788526844.032822:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.033200:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001856 00000100:00100000:3.0:1788526844.033215:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001856 00000100:00100000:3.0:1788526844.033447:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1788526844.033461:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13774:x1875405869001856:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788526844.033892:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13774:x1875405869001856:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 433us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.033902:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:1.0:1788526844.044428:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526844.044831:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869001984 00000100:00100000:2.0:1788526844.044848:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869001984 00000100:00100000:0.0:1788526844.046661:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1788526844.046746:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13774:x1875405869001984:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526844.047835:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13774:x1875405869001984:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 1151us (3413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526844.047861:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1788526844.058898:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526844.060449:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002112 00000100:00100000:1.0:1788526844.060469:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002112 00000100:00100000:1.0:1788526844.060547:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1788526844.060558:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1875405869002112:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788526844.060620:0:14318:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 32158e92-3529-4d93-b45d-044ba1cc8762@192.168.204.59@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1788526844.060702:0:14318:0:(genops.c:1385:class_connect()) connect: client 32158e92-3529-4d93-b45d-044ba1cc8762, cookie 0x367645d450b3b5fd 00000004:00100000:1.0:1788526844.060745:0:14318:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788526844.060753:0:14318:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788526844.095735:0:14318:0:(import.c:65:import_set_state_nolock()) ffff98c281ea3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788526844.095854:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+6:2347:x1875405869002112:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 35293us (36970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526844.095880:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1788526844.098207:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526844.098534:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002368 00000100:00100000:2.0:1788526844.098548:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002368 00000100:00080000:1.0:1788526844.098722:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526844.098784:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526844.099004:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002240 00000100:00100000:2.0:1788526844.099009:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002240 00000100:00100000:2.0:1788526844.099045:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526844.099059:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:13750:x1875405869002368:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788526844.099125:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788526844.099259:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:13750:x1875405869002368:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 202us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.099267:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526844.099290:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1788526844.099297:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:0:x1875405869002240:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788526844.099309:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788526844.099333:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:0:x1875405869002240:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.099340:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1788526844.101961:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.102071:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002496 00000100:00100000:3.0:1788526844.102084:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002496 00000100:00100000:3.0:1788526844.102155:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1788526844.102167:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:13750:x1875405869002496:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788526844.102290:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:13750:x1875405869002496:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.102298:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1788526844.104849:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.104894:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526844.105027:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002624 00000100:00100000:0.0:1788526844.105039:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002624 00000100:00100000:0.0:1788526844.105084:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002752 00000100:00100000:0.0:1788526844.105087:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002752 00000100:00100000:0.0:1788526844.105102:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526844.105112:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405869002624:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788526844.105158:0:15000:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 32158e92-3529-4d93-b45d-044ba1cc8762@192.168.204.59@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788526844.105201:0:15000:0:(genops.c:1385:class_connect()) connect: client 32158e92-3529-4d93-b45d-044ba1cc8762, cookie 0x367645d450b3b604 00002000:00100000:0.0:1788526844.105217:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 32158e92-3529-4d93-b45d-044ba1cc8762/ffff98c26e9e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788526844.105245:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788526844.105720:0:15000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788526844.105768:0:15000:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526844.105865:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:2347:x1875405869002624:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 753us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526844.105874:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1788526844.105897:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1788526844.105901:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405869002752:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788526844.105920:0:15000:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 32158e92-3529-4d93-b45d-044ba1cc8762@192.168.204.59@tcp t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788526844.105937:0:15000:0:(genops.c:1385:class_connect()) connect: client 32158e92-3529-4d93-b45d-044ba1cc8762, cookie 0x367645d450b3b60b 00002000:00100000:0.0:1788526844.105943:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 32158e92-3529-4d93-b45d-044ba1cc8762/ffff98c26e9e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788526844.105963:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788526844.106830:0:15000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788526844.106862:0:15000:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526844.106910:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:2347:x1875405869002752:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 1006us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526844.106918:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1788526844.109344:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.109539:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869002880 00000100:00100000:3.0:1788526844.109570:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869002880 00000100:00100000:3.0:1788526844.109650:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526844.109663:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:13750:x1875405869002880:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788526844.113502:0:14319:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3734us 00000004:00200000:3.0:1788526844.133649:0:14319:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788526844.133957:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:13750:x1875405869002880:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 24288us (24618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.133971:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1788526844.293841:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526844.293968:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003008 00000100:00100000:3.0:1788526844.293985:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003008 00000100:00100000:3.0:1788526844.294077:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526844.294090:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:13795:x1875405869003008:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:3.0:1788526844.294137:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526844.294172:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc597f6 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294264:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294282:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294299:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526844.294346:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788526844.294350:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526844.294431:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294483:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6c00/0x367645d450b3b612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597f6 expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294508:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597f6 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526844.294518:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:3.0:1788526844.294521:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788526844.294525:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7400, rc 0) 00000100:00100000:3.0:1788526844.294620:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:13795:x1875405869003008:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 532us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.294627:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526844.371826:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788526844.371865:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881586048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526844.371968:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526844.372382:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586048 00000100:00100000:1.0:1788526844.372436:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586048 00000100:00100000:1.0:1788526844.372530:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526844.372543:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881586048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526844.372575:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526844.372657:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881586048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526844.372665:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788526844.372742:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788526844.372771:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274961c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881586048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788526844.372846:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788526844.373108:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881586432:0@lo:400:kworker.0 00000100:00100000:3.0:1788526844.373236:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881586304:0@lo:400:kworker.0 00000100:00100000:3.0:1788526844.373279:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526844.373424:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586304 00000100:00100000:2.0:1788526844.373430:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586304 00000100:00100000:2.0:1788526844.373488:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526844.373497:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881586304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373547:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881586304:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.373555:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788526844.373576:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881586560:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373620:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526844.373644:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788526844.373651:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881586176:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373702:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526844.373729:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881586688:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373753:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526844.373796:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881586304:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373820:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586560 00000100:00100000:2.0:1788526844.373824:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586560 00000100:00100000:2.0:1788526844.373855:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586688 00000100:00100000:2.0:1788526844.373858:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586688 00000100:00100000:2.0:1788526844.373876:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526844.373882:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881586560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373916:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881586560:12345-0@lo:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.373922:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788526844.373954:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526844.373960:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881586688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.373989:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875405881586688:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526844.373996:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788526844.374022:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3278:1875405881586688:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.374032:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881586560:0@lo:400:kworker.0 00000100:00100000:3.0:1788526844.374260:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586176 00000100:00100000:3.0:1788526844.374266:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586176 00000100:00100000:3.0:1788526844.374308:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788526844.374315:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3278:x1875405881586176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526844.374354:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3278:x1875405881586176:12345-0@lo:400:kworker.0 Request processed in 39us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526844.374361:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788526844.374460:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526844.374477:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526844.374657:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526844.374736:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586432 00000100:00100000:0.0:1788526844.374741:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586432 00000100:00100000:0.0:1788526844.374769:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788526844.374777:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881586432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526844.374818:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875405881586432:12345-0@lo:400:kworker.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526844.374825:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788526844.374857:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875405881586432:0@lo:400:kworker.0 00000100:00100000:2.0:1788526844.375033:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881586176:0@lo:400:kworker.0 00010000:00010000:0.0:1788526844.563866:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788526844.951025:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32158e92-3529-4d93-b45d-044ba1cc8762 00000040:00080000:2.0:1788526845.013076:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788526845.587606:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526846.506232:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.506422:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003136 00000100:00100000:2.0:1788526846.506433:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003136 00000100:00100000:2.0:1788526846.506510:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1788526846.506521:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+7:13848:x1875405869003136:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:2.0:1788526846.506580:0:14317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788526846.506686:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+7:13848:x1875405869003136:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 166us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.506693:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:3.0:1788526846.506873:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526846.514085:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.514420:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003264 00000100:00100000:1.0:1788526846.514433:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003264 00000100:00100000:1.0:1788526846.514507:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1788526846.514518:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32158e92-3529-4d93-b45d-044ba1cc8762+6:13848:x1875405869003264:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:1.0:1788526846.514573:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526846.514663:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32158e92-3529-4d93-b45d-044ba1cc8762+6:13848:x1875405869003264:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 147us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526846.514671:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00080000:3.0:1788526846.514920:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526846.520527:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.520661:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003392 00000100:00100000:2.0:1788526846.520672:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003392 00000100:00100000:2.0:1788526846.520799:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1788526846.520810:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32158e92-3529-4d93-b45d-044ba1cc8762+5:13848:x1875405869003392:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:2.0:1788526846.520850:0:15005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526846.520948:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32158e92-3529-4d93-b45d-044ba1cc8762+5:13848:x1875405869003392:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 139us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.520983:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00080000:3.0:1788526846.532059:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788526846.611905:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526846.730872:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526846.730972:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003520 00000100:00100000:3.0:1788526846.730984:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003520 00000100:00100000:3.0:1788526846.731064:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:3.0:1788526846.731076:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+10:13879:x1875405869003520:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788526846.731095:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526846.731115:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e6c00/0x367645d450b3b620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc597fd expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526846.731148:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e6c00/0x367645d450b3b620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597fd expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526846.731163:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e6c00/0x367645d450b3b620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597fd expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526846.731173:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6c00, rc 0) 00000100:00100000:3.0:1788526846.731253:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+11:13879:x1875405869003520:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 180us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526846.731260:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:0.0:1788526846.741505:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.741613:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003648 00000100:00100000:2.0:1788526846.741624:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003648 00000100:00100000:2.0:1788526846.741692:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:2.0:1788526846.741702:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+11:13879:x1875405869003648:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788526846.742010:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+11:13879:x1875405869003648:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 309us (518us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788526846.742019:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:1.0:1788526846.767016:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.767129:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003776 00000100:00100000:0.0:1788526846.767140:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003776 00000100:00100000:0.0:1788526846.767210:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:0.0:1788526846.767220:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+11:13879:x1875405869003776:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526846.767236:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526846.767267:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e820400/0x367645d450b3b627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59804 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.767828:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e820400/0x367645d450b3b627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59804 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.767845:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e820400/0x367645d450b3b627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59804 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.767857:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820400, rc 0) 00000100:00100000:0.0:1788526846.767933:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b73fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869003776:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 714us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.767941:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:0.0:1788526846.774613:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526846.774754:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869003904 00000100:00100000:3.0:1788526846.774765:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869003904 00000100:00100000:3.0:1788526846.774823:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:3.0:1788526846.774834:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869003904:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788526846.775155:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869003904:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 322us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526846.775174:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1788526846.792740:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.793078:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004032 00000100:00100000:0.0:1788526846.793090:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004032 00000100:00100000:0.0:1788526846.793155:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1788526846.793166:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869004032:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788526846.794026:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869004032:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 859us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.794035:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1788526846.806438:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.806609:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004160 00000100:00100000:2.0:1788526846.806621:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004160 00000100:00100000:2.0:1788526846.806678:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:2.0:1788526846.806690:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13887:x1875405869004160:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788526846.807027:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13887:x1875405869004160:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 339us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.807036:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1788526846.832755:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.836248:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004288 00000100:00100000:0.0:1788526846.836268:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004288 00000100:00100000:0.0:1788526846.836349:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1788526846.836361:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13887:x1875405869004288:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788526846.836732:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13887:x1875405869004288:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 372us (3991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.836749:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:2.0:1788526846.844707:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.845671:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004416 00000100:00100000:0.0:1788526846.845684:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004416 00000100:00100000:0.0:1788526846.845742:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:0.0:1788526846.845752:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13879:x1875405869004416:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526846.845771:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526846.845800:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821000/0x367645d450b3b62e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5982e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.845835:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821000/0x367645d450b3b62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5982e expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.845848:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821000/0x367645d450b3b62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5982e expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.845857:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821000, rc 0) 00000100:00100000:0.0:1788526846.845925:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13879:x1875405869004416:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 174us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.845933:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:1.0:1788526846.851989:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.852077:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004544 00000100:00100000:2.0:1788526846.852087:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004544 00000100:00100000:2.0:1788526846.852148:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1788526846.852158:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13879:x1875405869004544:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788526846.852186:0:14308:0:(mgs_nids.c:920:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788526846.852211:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788526846.852216:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788526846.852218:0:14308:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788526846.852225:0:14308:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788526846.855456:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13879:x1875405869004544:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 3286us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.855471:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1788526846.861809:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.861960:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004672 00000100:00100000:0.0:1788526846.861973:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004672 00000100:00100000:0.0:1788526846.862043:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:0.0:1788526846.862054:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13879:x1875405869004672:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788526846.862075:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526846.862212:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59835 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.862433:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.863035:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526846.863051:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821e00, rc 0) 00000100:00100000:0.0:1788526846.863462:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13879:x1875405869004672:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 1408us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.863472:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:1.0:1788526846.869290:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.870209:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004800 00000100:00100000:2.0:1788526846.870222:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004800 00000100:00100000:2.0:1788526846.870355:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:2.0:1788526846.870367:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13879:x1875405869004800:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788526846.871066:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13879:x1875405869004800:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 697us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.871076:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:1.0:1788526846.873878:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526846.874038:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869004928 00000100:00100000:0.0:1788526846.874051:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869004928 00000100:00100000:0.0:1788526846.874121:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:0.0:1788526846.874131:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13879:x1875405869004928:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788526846.874593:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13879:x1875405869004928:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 461us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.874601:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:3.0:1788526846.885752:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.885892:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005056 00000100:00100000:2.0:1788526846.885904:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005056 00000100:00100000:2.0:1788526846.886010:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:2.0:1788526846.886021:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13891:x1875405869005056:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788526846.886294:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13891:x1875405869005056:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 273us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.886302:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:2.0:1788526846.891884:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.893329:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005184 00000100:00100000:1.0:1788526846.893355:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005184 00000100:00100000:1.0:1788526846.893462:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:1.0:1788526846.893473:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13891:x1875405869005184:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788526846.893733:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13891:x1875405869005184:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 262us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526846.893742:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:1.0:1788526846.912383:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.912435:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.912596:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.912628:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.912675:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005824 00000100:00100000:1.0:1788526846.912685:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005824 00000100:00100000:1.0:1788526846.912743:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005952 00000100:00100000:1.0:1788526846.912746:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005952 00000100:00100000:1.0:1788526846.912764:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1788526846.912773:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+6:2351:x1875405869005824:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526846.912879:0:15000:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788526846.912890:0:15000:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788526846.913010:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1788526846.913020:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869005952:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526846.913092:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869005952:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.913100:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1788526846.913465:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+6:2351:x1875405869005824:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 692us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526846.913471:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1788526846.914767:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005312 00000100:00100000:2.0:1788526846.914846:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005312 00000100:00100000:2.0:1788526846.914924:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005440 00000100:00100000:2.0:1788526846.914929:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005440 00000100:00100000:2.0:1788526846.914959:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526846.914968:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+7:2351:x1875405869005440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526846.915073:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+7:2351:x1875405869005440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 105us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.915080:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526846.915098:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1788526846.915102:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1875405869005312:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788526846.915130:0:14317:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 1fda93c2-6592-4289-96e9-be3093fbc1e2@192.168.204.59@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:2.0:1788526846.915166:0:14317:0:(genops.c:1385:class_connect()) connect: client 1fda93c2-6592-4289-96e9-be3093fbc1e2, cookie 0x367645d450b3b63c 00000004:00100000:2.0:1788526846.915199:0:14317:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788526846.917619:0:14317:0:(import.c:65:import_set_state_nolock()) ffff98c275411000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788526846.917693:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2347:x1875405869005312:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 2585us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.917703:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526846.931615:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.931704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.932713:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005568 00000100:00100000:2.0:1788526846.932727:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005568 00000100:00100000:2.0:1788526846.932823:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869005696 00000100:00100000:2.0:1788526846.932827:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869005696 00000100:00100000:2.0:1788526846.932847:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526846.932856:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+7:0:x1875405869005568:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788526846.932901:0:14317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788526846.932979:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+7:0:x1875405869005568:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 123us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.932986:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526846.933006:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1788526846.933013:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869005696:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788526846.933042:0:14317:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788526846.933064:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869005696:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 52us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.933070:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00080000:1.0:1788526846.933258:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526846.946743:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526846.951572:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006080 00000100:00100000:2.0:1788526846.951588:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006080 00000100:00100000:2.0:1788526846.951662:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1788526846.951673:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869006080:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788526846.951804:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869006080:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 132us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526846.951812:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1788526846.954603:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.954639:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526846.954704:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526846.954911:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006464 00000100:00100000:3.0:1788526846.954935:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006464 00000100:00100000:3.0:1788526846.954990:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1788526846.955000:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869006464:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788526846.955089:0:14320:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788526846.955168:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13879:x1875405869006464:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 169us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526846.955299:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526846.957676:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006208 00000100:00100000:0.0:1788526846.957708:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006208 00000100:00100000:0.0:1788526846.957806:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006336 00000100:00100000:0.0:1788526846.957810:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006336 00000100:00100000:0.0:1788526846.957844:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1788526846.957853:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405869006208:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788526846.957887:0:15000:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 1fda93c2-6592-4289-96e9-be3093fbc1e2@192.168.204.59@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788526846.957923:0:15000:0:(genops.c:1385:class_connect()) connect: client 1fda93c2-6592-4289-96e9-be3093fbc1e2, cookie 0x367645d450b3b643 00002000:00100000:0.0:1788526846.957935:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1fda93c2-6592-4289-96e9-be3093fbc1e2/ffff98c26e9e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788526846.957948:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788526846.958083:0:15000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788526846.958120:0:15000:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526846.958206:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2347:x1875405869006208:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 352us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.958214:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1788526846.958254:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1788526846.958259:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1875405869006336:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788526846.958276:0:15000:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 1fda93c2-6592-4289-96e9-be3093fbc1e2@192.168.204.59@tcp t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788526846.958294:0:15000:0:(genops.c:1385:class_connect()) connect: client 1fda93c2-6592-4289-96e9-be3093fbc1e2, cookie 0x367645d450b3b64a 00002000:00100000:0.0:1788526846.958299:0:15000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1fda93c2-6592-4289-96e9-be3093fbc1e2/ffff98c26e9e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788526846.958316:0:15000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788526846.958548:0:15000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788526846.958566:0:15000:0:(import.c:65:import_set_state_nolock()) ffff98c26e9e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788526846.958593:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2347:x1875405869006336:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 331us (3953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526846.958600:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1788526847.268190:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526847.268282:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006592 00000100:00100000:3.0:1788526847.268293:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006592 00000100:00100000:3.0:1788526847.268351:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1788526847.268361:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:13912:x1875405869006592:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:3.0:1788526847.268466:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526847.268488:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5985f expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269370:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269467:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269483:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526847.269520:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788526847.269546:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526847.269570:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269599:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6400/0x367645d450b3b651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 8 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269618:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526847.269626:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:3.0:1788526847.269629:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788526847.269633:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6800, rc 0) 00000100:00100000:3.0:1788526847.269904:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+7:13912:x1875405869006592:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 1542us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526847.269912:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:1.0:1788526847.635539:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526847.955822:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788526847.955862:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881586816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526847.955947:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526847.956173:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586816 00000100:00100000:2.0:1788526847.956183:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586816 00000100:00100000:2.0:1788526847.956257:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788526847.956266:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881586816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526847.956304:0:15005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526847.956353:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881586816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526847.956360:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788526847.956507:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526847.956716:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881586816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788526848.659942:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788526849.045302:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fda93c2-6592-4289-96e9-be3093fbc1e2 00000001:00100000:1.0:1788526849.045315:0:6693:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32158e92-3529-4d93-b45d-044ba1cc8762 00000100:00100000:3.0:1788526849.491702:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526849.491727:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881586944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788526849.491812:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.491877:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881586944 00000100:00100000:1.0:1788526849.491887:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881586944 00000100:00100000:1.0:1788526849.491950:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788526849.491960:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881586944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788526849.491992:0:15005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788526849.492051:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881586944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526849.492058:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788526849.492101:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881586944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788526849.492258:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526849.495112:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881587200:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495193:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.495235:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788526849.495242:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881587072:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495273:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.495310:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495338:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.495366:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881587328:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495436:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.495459:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788526849.495465:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881587456:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495505:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526849.495535:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587584 00000100:00100000:1.0:1788526849.495542:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587584 00000100:00100000:1.0:1788526849.495587:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587328 00000100:00100000:1.0:1788526849.495591:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587328 00000100:00100000:1.0:1788526849.495604:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587456 00000100:00100000:1.0:1788526849.495607:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587456 00000100:00100000:1.0:1788526849.495623:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788526849.495632:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881587584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495683:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875405881587584:12345-0@lo:400:kworker.0 Request processed in 52us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526849.495703:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788526849.495723:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788526849.495730:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881587328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495763:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875405881587328:12345-0@lo:400:kworker.0 Request processed in 33us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526849.495769:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788526849.495782:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526849.495789:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881587456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495814:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881587456:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526849.495820:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788526849.495858:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3279:1875405881587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495902:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881587456:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495912:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875405881587328:0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.495946:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587072 00000100:00100000:1.0:1788526849.495950:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587072 00000100:00100000:1.0:1788526849.495977:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788526849.495984:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3279:x1875405881587072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526849.496036:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3279:x1875405881587072:12345-0@lo:400:kworker.0 Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526849.496043:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788526849.496078:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25a41ce-5827-423c-b0c5-e955955f4e9e:3279:1875405881587072:0@lo:400:kworker.0 00000100:00100000:3.0:1788526849.499896:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587200 00000100:00100000:3.0:1788526849.499912:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587200 00000100:00100000:3.0:1788526849.499982:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526849.499993:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881587200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526849.500081:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881587200:12345-0@lo:400:kworker.0 Request processed in 91us (4888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526849.500091:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788526849.500126:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788526849.500141:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526849.501996:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881587200:0@lo:400:kworker.0 00000001:00100000:2.0:1788526849.545663:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32158e92-3529-4d93-b45d-044ba1cc8762 00000001:00100000:2.0:1788526849.545684:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1fda93c2-6592-4289-96e9-be3093fbc1e2 00010000:00010000:1.0:1788526849.683535:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788526850.076508:0:15988:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1fda93c2-6592-4289-96e9-be3093fbc1e2 00000001:02000400:2.0:1788526850.504944:0:16285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788526850.707597:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526851.731831:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526852.254356:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254439:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254469:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254487:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254504:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254521:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254542:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526852.254580:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006720 00000100:00100000:3.0:1788526852.254590:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006720 00000100:00100000:3.0:1788526852.254640:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:3.0:1788526852.254651:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2348:x1875405869006720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.254720:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2348:x1875405869006720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.254728:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:3.0:1788526852.254762:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006976 00000100:00100000:3.0:1788526852.254766:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006976 00000100:00100000:3.0:1788526852.254795:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007488 00000100:00100000:3.0:1788526852.254798:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007488 00000100:00100000:3.0:1788526852.254812:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007104 00000100:00100000:3.0:1788526852.254814:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007104 00000100:00100000:3.0:1788526852.254828:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007360 00000100:00100000:3.0:1788526852.254830:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007360 00000100:00100000:3.0:1788526852.254845:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1788526852.254851:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869006976:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.254879:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869006976:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.254901:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1788526852.254915:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526852.254922:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2348:x1875405869007488:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.254947:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2348:x1875405869007488:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.254952:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1788526852.254963:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1788526852.254969:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869007104:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.254991:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869007104:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.254996:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1788526852.255007:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1788526852.255012:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2348:x1875405869007360:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.255033:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2348:x1875405869007360:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.255039:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1788526852.255059:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007232 00000100:00100000:3.0:1788526852.255063:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007232 00000100:00100000:3.0:1788526852.255088:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869006848 00000100:00100000:3.0:1788526852.255091:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869006848 00000100:00100000:3.0:1788526852.255104:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1788526852.255110:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2348:x1875405869007232:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.255137:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2348:x1875405869007232:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.255149:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1788526852.255162:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1788526852.255168:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+6:2348:x1875405869006848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526852.255193:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+6:2348:x1875405869006848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526852.255198:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00080000:3.0:1788526852.255355:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788526852.255360:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526852.255362:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788526852.755592:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526853.078743:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881587712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526853.078851:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526853.080678:0:15005:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587712 00000100:00100000:3.0:1788526853.080699:0:15005:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587712 00000100:00100000:3.0:1788526853.080789:0:15005:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788526853.080801:0:15005:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881587712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526853.080857:0:15005:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788526853.081465:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788526853.083214:0:15005:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881587712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2404us (4352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526853.083231:0:15005:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788526853.084343:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881587712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788526853.779753:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526854.611864:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881588096:0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.611981:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526854.612073:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788526854.612081:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881588224:0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.612115:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526854.612152:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588096 00000100:00100000:2.0:1788526854.612174:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588096 00000100:00100000:2.0:1788526854.612249:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526854.612260:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881588096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.612323:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881588096:12345-0@lo:400:kworker.0 Request processed in 65us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526854.612332:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526854.612362:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588224 00000100:00100000:2.0:1788526854.612366:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588224 00000100:00100000:2.0:1788526854.612430:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788526854.612438:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881588224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.612470:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881588224:12345-0@lo:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526854.612476:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788526854.612494:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526854.612540:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881588224:0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.612551:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881588096:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.612884:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881587840:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.612931:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.612976:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881588352:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613003:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.613036:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788526854.613043:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881587968:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613066:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.613085:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881588480:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613127:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.613154:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588352 00000100:00100000:3.0:1788526854.613159:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588352 00000100:00100000:3.0:1788526854.613188:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588480 00000100:00100000:3.0:1788526854.613190:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588480 00000100:00100000:3.0:1788526854.613204:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788526854.613209:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881588352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613247:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875405881588352:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.613253:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788526854.613267:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788526854.613273:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881588480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613296:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881588480:12345-0@lo:400:kworker.0 Request processed in 24us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.613301:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788526854.613317:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587968 00000100:00100000:3.0:1788526854.613319:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587968 00000100:00100000:3.0:1788526854.613342:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526854.613348:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881587968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613376:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881587968:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.613410:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788526854.613442:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881587968:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613452:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881588480:0@lo:400:kworker.0 00000100:00100000:3.0:1788526854.613460:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3280:1875405881588352:0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.614158:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881587840 00000100:00100000:2.0:1788526854.614168:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881587840 00000100:00100000:2.0:1788526854.614217:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788526854.614225:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881587840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.614290:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881587840:12345-0@lo:400:kworker.0 Request processed in 65us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526854.614306:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1788526854.614346:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788526854.614378:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881587840:0@lo:400:kworker.0 00000100:00100000:2.0:1788526854.625243:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881588608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526854.625351:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526854.625476:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588608 00000100:00100000:2.0:1788526854.625487:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588608 00000100:00100000:2.0:1788526854.625552:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526854.625562:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881588608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526854.625612:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526854.625667:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881588608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526854.625675:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788526854.625736:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881588608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788526854.812554:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788526854.836656:0:16433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee8a44cd0 20000000:00000080:0.0:1788526854.836683:0:16433:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98c14327d000 uarg=0000000000000000 20000000:01000000:0.0:1788526854.836728:0:16433:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788526854.836735:0:16433:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788526854.836741:0:16433:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788526854.838094:0:16434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788526854.838291:0:16433:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788526854.842743:0:16433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788526854.842954:0:16433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843082:0:16433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b32c expref: 20 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843091:0:16433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b387 expref: 20 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843099:0:16433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843135:0:16433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843144:0:16433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843153:0:16433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843211:0:16433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843231:0:16433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.843251:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588736:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526854.843470:0:16433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843480:0:16433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.843489:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588864:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526854.843516:0:16433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843524:0:16433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.843547:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588992:0@lo:104: 00000100:00100000:2.0:1788526854.843611:0:16433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788526854.843658:0:16433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 20 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843667:0:16433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 20 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.843675:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881589120:0@lo:104: 00000100:00100000:2.0:1788526854.843696:0:16433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788526854.843726:0:16433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 20 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.843734:0:16433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 20 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.843742:0:16433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881589248:0@lo:104: 00000100:00100000:2.0:1788526854.843769:0:16433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526854.843779:0:16433:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27fbfe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788526854.843922:0:14300:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788526854.843943:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881588992 00000100:00100000:3.0:1788526854.843952:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881588992 00000100:00100000:3.0:1788526854.844017:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589120 00000100:00100000:3.0:1788526854.844291:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589120 00000100:00100000:3.0:1788526854.844313:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589248 00000100:00100000:3.0:1788526854.844316:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589248 00000100:00100000:3.0:1788526854.844329:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526854.844339:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:16433:x1875405881588992:12345-0@lo:104: 00010000:00010000:3.0:1788526854.844360:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844471:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788526854.844479:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+5:16433:x1875405881588992:12345-0@lo:104: Request processed in 140us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.844487:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526854.844510:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526854.844516:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+4:16433:x1875405881589120:12345-0@lo:104: 00010000:00010000:3.0:1788526854.844525:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844564:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788526854.844569:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+4:16433:x1875405881589120:12345-0@lo:104: Request processed in 53us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.844575:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526854.844588:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526854.844594:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2430c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:16433:x1875405881589248:12345-0@lo:104: 00010000:00010000:3.0:1788526854.844613:0:14300:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844644:0:14300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788526854.844648:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2430c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25a41ce-5827-423c-b0c5-e955955f4e9e+3:16433:x1875405881589248:12345-0@lo:104: Request processed in 56us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.844655:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788526854.844707:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788526854.844717:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844726:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7e00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526854.844732:0:14304:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844742:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526854.844750:0:14304:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526854.844756:0:14304:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788526854.844813:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844820:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526854.844930:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.844938:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b4d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b4d7 expref: -99 pid: 15720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526854.845097:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788526854.845114:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881589376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526854.845158:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788526854.845204:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788526854.845208:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845215:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526854.845219:0:14304:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845226:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526854.845233:0:14304:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526854.845238:0:14304:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788526854.845263:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845270:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788526854.845287:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845294:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c26e820600/0x367645d450b3b387 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b38e expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526854.845310:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881589504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526854.845341:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.845414:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589376 00000100:00100000:3.0:1788526854.845421:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589376 00010000:00010000:3.0:1788526854.845447:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 21 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526854.845471:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589504 00000100:00100000:3.0:1788526854.845474:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589504 00010000:00010000:3.0:1788526854.845486:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 22 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526854.845504:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526854.845510:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+22:3278:x1875405881589376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526854.845522:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526854.845528:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 22 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845539:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 22 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845563:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526854.845595:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+22:3278:x1875405881589376:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.845601:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788526854.845615:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526854.845622:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881589504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526854.845629:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526854.845633:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 21 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845652:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 21 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845664:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526854.845692:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881589504:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.845699:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788526854.845742:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881589504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526854.845767:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25a41ce-5827-423c-b0c5-e955955f4e9e:3278:1875405881589376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526854.845776:0:14304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788526854.845780:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845786:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242c77a00 already unused, calling callback (ffffffffc1b3fe00) 10000000:00010000:3.0:1788526854.845789:0:14304:0:(mgc_request.c:1147:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845797:0:14304:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788526854.845803:0:14304:0:(mgc_request.c:1153:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526854.845808:0:14304:0:(mgc_request.c:1157:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788526854.845832:0:14304:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.845839:0:14304:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788526854.846006:0:16433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821a00/0x367645d450b3b4d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b4d0 expref: 20 pid: 14311 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.846017:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588992:0@lo:104: 00010000:00010000:2.0:1788526854.846040:0:16433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c2743e6200/0x367645d450b3b38e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b387 expref: 19 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526854.846048:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881589120:0@lo:104: 00000100:00100000:2.0:1788526854.846057:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881589248:0@lo:104: 00010000:00010000:3.0:1788526854.846361:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.846370:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff98c242c77a00/0x367645d450b3b32c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x367645d450b3b333 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.846419:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526854.846421:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788526854.846423:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788526854.846489:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526854.846542:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881589632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788526854.846598:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526854.846692:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589632 00000100:00100000:3.0:1788526854.846699:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589632 00010000:00010000:3.0:1788526854.846722:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 19 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526854.846854:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788526854.846863:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:3281:x1875405881589632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788526854.846876:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526854.846881:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 19 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.846892:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 19 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.846906:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821200/0x367645d450b3b333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x367645d450b3b32c expref: 19 pid: 14308 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526854.846918:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526854.847089:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2451ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:3281:x1875405881589632:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.847100:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788526854.847201:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25a41ce-5827-423c-b0c5-e955955f4e9e:3281:1875405881589632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788526854.853106:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526854.853310:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588736:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526854.853324:0:16433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16433:1875405881588864:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526854.853374:0:16433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526854.853516:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007616 00000100:00100000:1.0:1788526854.853526:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007616 00010000:00010000:1.0:1788526854.853583:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526854.853629:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526854.853639:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2349:x1875405869007616:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526854.853660:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526854.853666:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.853696:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.853717:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c26e821e00/0x367645d450b3b635 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59835 expref: 14 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.853736:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788526854.853801:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2447d4eb-66e0-4350-ab08-0b300bd12120+13:2349:x1875405869007616:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 164us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526854.853810:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1788526854.863804:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526854.863979:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007744 00000100:00100000:1.0:1788526854.863994:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007744 00010000:00010000:1.0:1788526854.864114:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526854.864167:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1788526854.864179:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2447d4eb-66e0-4350-ab08-0b300bd12120+13:2348:x1875405869007744:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788526854.864202:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526854.864209:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864224:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864248:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1423c8600/0x367645d450b3b5f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597cc expref: 13 pid: 14310 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864270:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864300:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864328:0:14303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864337:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864344:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864352:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864360:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526854.864365:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.864644:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.875432:0:16433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526854.875461:0:16433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.877613:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.877640:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98c1423c9c00/0x367645d450b3b65f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526854.877674:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526854.877991:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:2348:x1875405869007744:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 13806us (14196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526854.878004:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000040:00080000:0.0:1788526855.253454:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788526855.828153:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788526856.211871:0:14313:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788526856.211877:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c27fab5000 from 10 10000000:01000000:3.0:1788526856.211881:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526856.211931:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.211944:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.211956:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526856.211988:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881589760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.212059:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526856.212122:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c244d2e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.213462:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589760 00000100:00100000:2.0:1788526856.213474:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589760 00000100:00100000:2.0:1788526856.213535:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788526856.213546:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+18:14313:x1875405881589760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526856.213564:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526856.213585:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1423c8a00/0x367645d450b3b66d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b666 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.213612:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1423c8a00/0x367645d450b3b66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b666 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.213624:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1423c8a00/0x367645d450b3b66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b666 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.213633:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8a00, rc 0) 00000100:00100000:2.0:1788526856.213711:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881589760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.213725:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788526856.213780:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b522300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881589760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526856.213799:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b66d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.213809:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b66d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526856.214528:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 10 00000040:00080000:2.0:1788526856.215549:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526856.215794:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:2.0:1788526856.215840:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:2.0:1788526856.215887:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:2.0:1788526856.215922:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:2.0:1788526856.215953:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:2.0:1788526856.216001:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:2.0:1788526856.216037:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:2.0:1788526856.216072:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:2.0:1788526856.216143:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:2.0:1788526856.216151:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 9 count 10 00000100:00100000:2.0:1788526856.216236:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881589888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.218525:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.218581:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27fbfe240 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.218608:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881589888 00000100:00100000:2.0:1788526856.218616:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881589888 00000100:00100000:2.0:1788526856.218662:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788526856.218671:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881589888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.218922:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881589888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.218936:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788526856.218987:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881589888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.219034:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.219072:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.219087:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27fbfe240 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.219113:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590016 00000100:00100000:2.0:1788526856.219117:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590016 00000100:00100000:2.0:1788526856.220548:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788526856.220565:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.220811:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.220819:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788526856.220881:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.222060:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526856.222154:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590144:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.222219:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.222258:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590144 00000100:00100000:2.0:1788526856.222264:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590144 00000100:00100000:2.0:1788526856.222299:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788526856.222307:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590144:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.222495:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590144:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 189us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.222503:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788526856.222552:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.222575:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590144:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.222835:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:2.0:1788526856.222887:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:2.0:1788526856.222943:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:2.0:1788526856.222981:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:2.0:1788526856.223016:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:2.0:1788526856.223062:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:2.0:1788526856.223104:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:2.0:1788526856.224144:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000100:00100000:2.0:1788526856.224197:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590272:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.225711:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.225753:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590272 00000100:00100000:2.0:1788526856.225761:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590272 00000100:00100000:2.0:1788526856.225806:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788526856.225816:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590272:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.226016:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590272:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 201us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.226024:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788526856.226082:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.226106:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590272:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.227761:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:2.0:1788526856.227790:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:2.0:1788526856.230019:0:16496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 10 00000020:01000000:2.0:1788526856.230082:0:14313:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788526856.230096:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788526856.230107:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b66d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230423:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e6400/0x367645d450b3b666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b66d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788526856.230441:0:14313:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:2.0:1788526856.230444:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c2482e8000 from 10 10000000:01000000:2.0:1788526856.230447:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788526856.230484:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230492:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230503:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526856.230527:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.230594:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.230635:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.230658:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590400 00000100:00100000:2.0:1788526856.230666:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590400 00000100:00100000:2.0:1788526856.230708:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788526856.230716:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+19:14313:x1875405881590400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526856.230729:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526856.230743:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c1423c8400/0x367645d450b3b67b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b674 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230768:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c1423c8400/0x367645d450b3b67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b674 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230791:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c1423c8400/0x367645d450b3b67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b674 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230800:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8400, rc 0) 00000100:00100000:2.0:1788526856.230846:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.230854:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788526856.230900:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526856.230915:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b67b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.230924:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b67b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526856.233185:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000040:00080000:2.0:1788526856.235896:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526856.236248:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1788526856.236311:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:2.0:1788526856.236414:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:2.0:1788526856.236459:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:2.0:1788526856.236493:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:2.0:1788526856.236542:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:2.0:1788526856.236576:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:2.0:1788526856.236621:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:2.0:1788526856.236698:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:2.0:1788526856.236707:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 9 count 10 00000100:00100000:2.0:1788526856.236807:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.236883:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.236943:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526856.237590:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590528 00000100:00100000:1.0:1788526856.237598:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590528 00000100:00100000:1.0:1788526856.237673:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788526856.237684:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788526856.237930:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526856.237937:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788526856.237940:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.238042:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.238084:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.238117:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526856.238167:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590656 00000100:00100000:1.0:1788526856.238172:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590656 00000100:00100000:1.0:1788526856.238201:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788526856.238208:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788526856.238364:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526856.238370:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788526856.238603:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.239171:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788526856.239236:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590784:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.240582:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.240623:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526856.241586:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590784 00000100:00100000:3.0:1788526856.241597:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590784 00000100:00100000:3.0:1788526856.241645:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788526856.241654:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590784:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.241909:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590784:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 256us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526856.241918:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788526856.243014:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590784:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.243531:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:2.0:1788526856.243624:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:2.0:1788526856.243703:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:2.0:1788526856.243758:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:2.0:1788526856.243807:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:2.0:1788526856.244205:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:2.0:1788526856.244303:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:2.0:1788526856.244340:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:2.0:1788526856.244493:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590912:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.244569:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.244652:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b6793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526856.244913:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881590912 00000100:00100000:1.0:1788526856.244921:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881590912 00000100:00100000:1.0:1788526856.245007:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788526856.245016:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590912:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788526856.245224:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881590912:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 208us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526856.245232:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788526856.245361:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881590912:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788526856.245503:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788526856.245517:0:14313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:1.0:1788526856.247927:0:16497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 10 00000020:01000000:3.0:1788526856.248036:0:14313:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788526856.248049:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788526856.248065:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b67b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.248076:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c1423c9600/0x367645d450b3b674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b67b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788526856.248087:0:14313:0:(mgc_request.c:714:do_requeue()) updating log params 10000000:01000000:3.0:1788526856.248090:0:14313:0:(mgc_request.c:2062:mgc_process_log()) Process log params-ffff98c244e62800 from 10 10000000:01000000:3.0:1788526856.248092:0:14313:0:(mgc_request.c:1239:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788526856.248128:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.248135:0:14313:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.248145:0:14313:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526856.248168:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.248230:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526856.248281:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c244d2e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788526856.249079:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591040 00000100:00100000:1.0:1788526856.249088:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591040 00000100:00100000:1.0:1788526856.249172:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788526856.249183:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+20:14313:x1875405881591040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788526856.249196:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526856.249221:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c245111600/0x367645d450b3b689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x367645d450b3b682 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526856.249599:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c245111600/0x367645d450b3b689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x367645d450b3b682 expref: 21 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526856.249612:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c245111600/0x367645d450b3b689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x367645d450b3b682 expref: 21 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526856.249621:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111600, rc 0) 00000100:00100000:1.0:1788526856.249772:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881591040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 590us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526856.249780:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788526856.250015:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788526856.250036:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b689 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526856.250056:0:14313:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x367645d450b3b689 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526856.250106:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.250137:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526856.250589:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591168 00000100:00100000:3.0:1788526856.250597:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591168 00000100:00100000:3.0:1788526856.250627:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788526856.250635:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881591168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.250911:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881591168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526856.250918:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788526856.251519:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c27b679f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526856.251542:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.251594:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27b521180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.251640:0:14313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526856.251675:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591296 00000100:00100000:2.0:1788526856.251680:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591296 00000100:00100000:2.0:1788526856.251712:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788526856.251720:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881591296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.251737:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c244d2e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788526856.252382:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:14313:x1875405881591296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 488us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.252411:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788526856.256426:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27b521180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25a41ce-5827-423c-b0c5-e955955f4e9e:14313:1875405881591296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788526856.260211:0:16500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788526856.261450:0:14313:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788526856.261465:0:14313:0:(mgc_request.c:2142:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788526856.261475:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b689 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.261488:0:14313:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff98c2743e7e00/0x367645d450b3b682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x367645d450b3b689 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526856.600364:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526856.600485:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869007872 00000100:00100000:0.0:1788526856.600495:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869007872 00000100:00100000:0.0:1788526856.600553:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:0.0:1788526856.600563:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+12:13764:x1875405869007872:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788526856.600580:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526856.600610:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c26e821e00/0x367645d450b3b690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59866 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526856.600643:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c26e821e00/0x367645d450b3b690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59866 expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526856.600656:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c26e821e00/0x367645d450b3b690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59866 expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526856.600666:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821e00, rc 0) 00000100:00100000:0.0:1788526856.600724:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869007872:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 162us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526856.600731:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:3.0:1788526856.608029:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526856.608311:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008000 00000100:00100000:0.0:1788526856.608322:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008000 00000100:00100000:0.0:1788526856.608414:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1788526856.608425:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869008000:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788526856.608730:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869008000:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 306us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526856.608739:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:2.0:1788526856.615001:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526856.615081:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008128 00000100:00100000:3.0:1788526856.615090:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008128 00000100:00100000:3.0:1788526856.615153:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:3.0:1788526856.615163:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869008128:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.615414:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869008128:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 252us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526856.615423:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:1.0:1788526856.624051:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526856.625359:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008256 00000100:00100000:3.0:1788526856.625374:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008256 00000100:00100000:3.0:1788526856.625772:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:3.0:1788526856.625784:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+13:13764:x1875405869008256:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788526856.625804:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526856.625840:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98c2743e7600/0x367645d450b3b697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5986d expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.625873:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98c2743e7600/0x367645d450b3b697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5986d expref: 14 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.625885:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98c2743e7600/0x367645d450b3b697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5986d expref: 14 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526856.625894:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e7600, rc 0) 00000100:00100000:3.0:1788526856.625967:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13764:x1875405869008256:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 186us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526856.625974:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1788526856.629258:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526856.629356:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008384 00000100:00100000:2.0:1788526856.629368:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008384 00000100:00100000:2.0:1788526856.629721:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1788526856.629732:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13764:x1875405869008384:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788526856.630292:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13764:x1875405869008384:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 558us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526856.630301:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:0.0:1788526856.633641:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526856.633717:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008512 00000100:00100000:3.0:1788526856.633727:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008512 00000100:00100000:3.0:1788526856.633850:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:3.0:1788526856.633860:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13764:x1875405869008512:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788526856.634095:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2447d4eb-66e0-4350-ab08-0b300bd12120+14:13764:x1875405869008512:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 236us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526856.634103:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00010000:00010000:1.0:1788526856.852632:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526857.372059:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526857.372110:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526857.372224:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008640 00000100:00100000:2.0:1788526857.372236:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008640 00000100:00100000:2.0:1788526857.372299:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:2.0:1788526857.372309:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2351:x1875405869008640:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526857.372465:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2351:x1875405869008640:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 157us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526857.372473:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:0.0:1788526857.372780:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008768 00000100:00100000:0.0:1788526857.372786:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008768 00000100:00100000:0.0:1788526857.372842:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1788526857.372851:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+6:2351:x1875405869008768:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526857.372892:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+6:2351:x1875405869008768:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 43us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526857.372909:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00080000:3.0:1788526857.372949:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788526857.376622:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526857.376743:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526857.376865:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869008896 00000100:00100000:0.0:1788526857.376879:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869008896 00000100:00100000:0.0:1788526857.376961:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009024 00000100:00100000:0.0:1788526857.376964:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009024 00000100:00100000:0.0:1788526857.376992:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1788526857.377003:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869008896:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526857.377078:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869008896:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 77us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526857.377087:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1788526857.377179:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1788526857.377187:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869009024:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526857.377215:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869009024:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526857.377221:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:3.0:1788526857.377969:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788526857.377975:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526857.381753:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526857.381889:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009280 00000100:00100000:0.0:1788526857.381900:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009280 00000100:00100000:0.0:1788526857.381976:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526857.381986:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2350:x1875405869009280:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526857.382060:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2350:x1875405869009280:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526857.382068:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:3.0:1788526857.383079:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788526857.383177:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526857.386307:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526857.386436:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009408 00000100:00100000:3.0:1788526857.386514:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009408 00000100:00080000:0.0:1788526857.386645:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788526857.386690:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1788526857.386702:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869009408:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1788526857.386784:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869009408:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 85us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526857.386801:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526857.387295:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009152 00000100:00100000:2.0:1788526857.387302:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009152 00000100:00100000:2.0:1788526857.387365:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1788526857.387373:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2351:x1875405869009152:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526857.387448:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2351:x1875405869009152:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (4269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526857.387455:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00080000:0.0:1788526857.387633:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788526857.875712:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526858.195783:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788526858.195811:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881591424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788526858.196002:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526858.196168:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591424 00000100:00100000:2.0:1788526858.196177:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591424 00000100:00100000:2.0:1788526858.196261:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788526858.196270:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881591424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788526858.196307:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788526858.196373:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881591424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526858.196380:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788526858.196559:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881591424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788526858.198476:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526858.538698:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526858.539009:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009536 00000100:00100000:1.0:1788526858.539031:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009536 00000100:00100000:1.0:1788526858.539104:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1788526858.539116:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:14422:x1875405869009536:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526858.539139:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526858.539163:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59874 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539257:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539273:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539285:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539301:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539320:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539327:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539699:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3b6b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539710:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3b6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539718:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3b6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526858.539743:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788526858.539747:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788526858.539786:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3b6b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539808:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539816:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.539823:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540032:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.540037:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540045:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540058:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:1.0:1788526858.540061:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.540065:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540072:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540086:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540091:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540097:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540108:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.540112:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540119:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540127:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98c272284c00) 00010000:00010000:1.0:1788526858.540130:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.540132:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540138:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540176:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245110400/0x367645d450b3b69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59874 expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540191:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111400/0x367645d450b3b6b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59874 expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.540199:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284000) 00010000:00010000:1.0:1788526858.540201:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788526858.540204:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111400, rc 0) 00000100:00100000:1.0:1788526858.540278:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:14422:x1875405869009536:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1164us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526858.540287:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526858.552968:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.553077:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009792 00000100:00100000:2.0:1788526858.553088:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009792 00000100:00100000:2.0:1788526858.553151:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1788526858.553166:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+7:14422:x1875405869009792:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788526858.553187:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526858.553210:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5987b expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553316:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553333:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553357:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553383:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553428:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553434:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553779:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9800/0x367645d450b3b6cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553788:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9800/0x367645d450b3b6cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.553795:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9800/0x367645d450b3b6cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526858.553804:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788526858.554025:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554043:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554050:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554056:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526858.554060:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554068:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554080:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98c272284000) 00010000:00010000:2.0:1788526858.554083:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526858.554088:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554093:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b6c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554106:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554112:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554119:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554124:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526858.554133:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554140:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554148:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98c250b85a00) 00010000:00010000:2.0:1788526858.554150:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526858.554153:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554159:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b6c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554722:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5987b expref: 10 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554739:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9800/0x367645d450b3b6cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5987b expref: 9 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.554746:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c250b85e00) 00010000:00010000:2.0:1788526858.554749:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526858.554751:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c9800, rc 0) 00000100:00100000:2.0:1788526858.554841:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+9:14422:x1875405869009792:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1680us (1884us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788526858.554851:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526858.571846:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.571945:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869009920 00000100:00100000:2.0:1788526858.571956:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869009920 00000100:00100000:2.0:1788526858.572027:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1788526858.572038:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+9:14422:x1875405869009920:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788526858.572226:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+9:14422:x1875405869009920:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 190us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526858.572235:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1788526858.626885:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526858.627014:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010048 00000100:00100000:1.0:1788526858.627042:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010048 00000100:00100000:1.0:1788526858.627115:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1788526858.627127:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+9:14428:x1875405869010048:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1788526858.627148:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526858.627178:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59882 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627258:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627277:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627289:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627315:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627323:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627330:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627569:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627579:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627586:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627599:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.627604:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627612:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627625:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:1.0:1788526858.627628:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.627632:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627638:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b6e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627651:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627656:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627661:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627666:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.627669:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627674:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627691:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98c272284c00) 00010000:00010000:1.0:1788526858.627693:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.627696:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627701:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b6eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627736:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59882 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627746:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:1.0:1788526858.627748:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.627752:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b6dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59882 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.627760:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111e00, rc 0) 00000100:00100000:1.0:1788526858.627833:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+9:14428:x1875405869010048:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 708us (959us total) trans 0 rc 301/301 00000100:00100000:1.0:1788526858.627840:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1788526858.632095:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.632356:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010176 00000100:00100000:2.0:1788526858.632366:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010176 00000100:00100000:3.0:1788526858.632720:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526858.632731:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:32158e92-3529-4d93-b45d-044ba1cc8762+9:14428:x1875405869010176:12345-192.168.204.59@tcp:700:lfs.0 00000100:00100000:3.0:1788526858.632825:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:32158e92-3529-4d93-b45d-044ba1cc8762+9:14428:x1875405869010176:12345-192.168.204.59@tcp:700:lfs.0 Request processed in 95us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526858.632833:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1788526858.634803:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.634896:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010432 00000100:00100000:2.0:1788526858.634905:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010432 00000100:00100000:2.0:1788526858.634969:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526858.634979:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+9:14428:x1875405869010432:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:2.0:1788526858.635033:0:14318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526858.635060:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc597f6 expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.635079:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:2.0:1788526858.635084:0:14318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788526858.635723:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.635740:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 5 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.635750:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.635783:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 5 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.635798:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 5 pid: 14318 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526858.635823:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881591552:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526858.635961:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2742d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788526858.639608:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881591552:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526858.639642:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526858.640515:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.640813:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010560 00000100:00100000:2.0:1788526858.640822:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010560 00010000:00010000:2.0:1788526858.640864:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 6 pid: 14318 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526858.640906:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1788526858.640917:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2348:x1875405869010560:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526858.640933:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526858.640940:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 6 pid: 14318 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.640962:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 6 pid: 14318 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.640983:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5985f expref: 6 pid: 14318 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.640999:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:2.0:1788526858.641005:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.641031:0:14302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.641037:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.641065:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526858.641115:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2348:x1875405869010560:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 200us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526858.641122:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00010000:00010000:3.0:1788526858.641365:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.641374:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.641439:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.641450:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.641458:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526858.644655:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788526858.644675:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644686:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644693:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644699:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526858.644704:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644713:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644733:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c259884f00) 00010000:00010000:3.0:1788526858.644736:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526858.644742:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.644749:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9400/0x367645d450b3b6f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526858.644773:0:14318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881c7a53 reply state 00000000a355e41d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526858.644783:0:14318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788526858.644912:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+10:14428:x1875405869010432:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 9930us (10112us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788526858.644936:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:1.0:1788526858.648499:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648518:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648526:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648546:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.648553:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648561:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648582:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98c259884300) 00010000:00010000:1.0:1788526858.648586:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526858.648592:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.648599:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b6f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526858.773205:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.773369:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010688 00000100:00100000:2.0:1788526858.773384:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010688 00000100:00100000:2.0:1788526858.773469:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526858.773480:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+9:14436:x1875405869010688:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:2.0:1788526858.773510:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526858.773536:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59889 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773612:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773628:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773647:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526858.773691:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788526858.773694:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526858.773761:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773793:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8600/0x367645d450b3b700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59889 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773817:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9c00/0x367645d450b3b707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59889 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.773826:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:2.0:1788526858.773830:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788526858.773835:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c9c00, rc 0) 00000100:00100000:2.0:1788526858.773912:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+10:14436:x1875405869010688:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 435us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526858.773919:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1788526858.816641:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526858.816730:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010816 00000100:00100000:3.0:1788526858.816742:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010816 00000100:00100000:3.0:1788526858.816806:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1788526858.816818:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:14437:x1875405869010816:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526858.816841:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526858.816863:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b70e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59890 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.816929:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b715 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.816945:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.816967:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526858.817007:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788526858.817011:0:14318:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526858.817032:0:14318:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b715 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.817060:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b70e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59890 expref: 7 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.817080:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6a00/0x367645d450b3b715 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59890 expref: 6 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.817109:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:3.0:1788526858.817113:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788526858.817116:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6a00, rc 0) 00000100:00100000:3.0:1788526858.817183:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:14437:x1875405869010816:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 367us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526858.817190:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1788526858.824596:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526858.824762:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869010944 00000100:00100000:0.0:1788526858.824774:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869010944 00000100:00100000:0.0:1788526858.824833:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1788526858.824844:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:14437:x1875405869010944:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526858.824866:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526858.824889:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59897 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825050:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825067:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825079:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825094:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825101:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825107:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825214:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825223:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825229:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526858.825260:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526858.825265:0:14317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526858.825286:0:14317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825309:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825316:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825323:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825329:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526858.825332:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825339:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825351:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:0.0:1788526858.825360:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526858.825365:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.825372:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826081:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826091:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826097:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826103:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526858.826106:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826113:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826122:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98c243972400) 00010000:00010000:0.0:1788526858.826125:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526858.826128:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826134:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b72a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826173:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59897 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826201:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59897 expref: 7 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.826208:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526858.826210:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526858.826213:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820600, rc 0) 00000100:00100000:0.0:1788526858.826354:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+7:14437:x1875405869010944:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1511us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526858.826362:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1788526858.837749:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.837853:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869011200 00000100:00100000:2.0:1788526858.837864:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869011200 00000100:00100000:2.0:1788526858.837931:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1788526858.837952:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+7:14437:x1875405869011200:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526858.837974:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526858.837994:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b738 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5989e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526858.838085:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788526858.838206:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b738 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5989e expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.838220:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:2.0:1788526858.838237:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788526858.838243:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b738 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5989e expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.838258:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8200, rc 0) 00000100:00100000:2.0:1788526858.838334:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+8:14437:x1875405869011200:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 394us (597us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788526858.838341:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1788526858.855817:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526858.855916:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869011456 00000100:00100000:0.0:1788526858.855927:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869011456 00000100:00100000:0.0:1788526858.856002:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1788526858.856013:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+8:14437:x1875405869011456:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:0.0:1788526858.856068:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526858.856095:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b731 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59897 expref: 8 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.856116:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526858.856127:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788526858.856153:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.856167:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.856177:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788526858.857079:0:14317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000904924bf reply state 00000000e65fd733 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526858.857093:0:14317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788526858.857102:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788526858.857249:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+9:14437:x1875405869011456:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 1236us (1441us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788526858.857258:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1788526858.867880:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526858.868490:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869011712 00000100:00100000:3.0:1788526858.868503:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869011712 00000100:00100000:3.0:1788526858.868563:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1788526858.868574:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+9:14437:x1875405869011712:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1788526858.868833:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+10:14437:x1875405869011712:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 260us (964us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788526858.868841:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00010000:00010000:1.0:1788526858.874713:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874731:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874738:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874744:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526858.874748:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874774:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874792:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972400) 00010000:00010000:1.0:1788526858.874794:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788526858.874799:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526858.874806:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b746 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526858.878630:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526858.879006:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869011968 00000100:00100000:3.0:1788526858.879018:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869011968 00000100:00100000:3.0:1788526858.879095:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1788526858.879107:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+9:14437:x1875405869011968:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526858.879133:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526858.879156:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598a5 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879245:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879262:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879291:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879321:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879329:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879337:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526858.879613:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788526858.879711:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879720:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879727:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879733:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526858.879738:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879745:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879758:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:3.0:1788526858.879760:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526858.879773:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879779:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879793:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879798:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879803:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879807:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526858.879811:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879816:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879823:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98c259884f00) 00010000:00010000:3.0:1788526858.879825:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526858.879828:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879834:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b75b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879872:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b74d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598a5 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879892:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:3.0:1788526858.879895:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526858.879899:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598a5 expref: 11 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.879909:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c2743e6800, rc 0) 00000100:00100000:3.0:1788526858.879990:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fda93c2-6592-4289-96e9-be3093fbc1e2+10:14437:x1875405869011968:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 885us (1371us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788526858.879996:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1788526858.882756:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526858.882845:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012096 00000100:00100000:0.0:1788526858.882854:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012096 00000100:00100000:0.0:1788526858.882916:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1788526858.882926:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+10:14437:x1875405869012096:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1788526858.882960:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526858.882985:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b769 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598ac expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883072:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883086:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883097:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526858.883122:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788526858.883125:0:14317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526858.883142:0:14317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883204:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820600/0x367645d450b3b769 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 12 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883224:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526858.883235:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526858.883238:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788526858.883242:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526858.883312:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+11:14437:x1875405869012096:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 387us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526858.883319:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1788526858.887829:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526858.888010:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012224 00000100:00100000:3.0:1788526858.888020:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012224 00000100:00100000:3.0:1788526858.888077:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1788526858.888088:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+11:14437:x1875405869012224:12345-192.168.204.59@tcp:37:lfs.0 00010000:00010000:1.0:1788526858.899558:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788526858.899874:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+11:14437:x1875405869012224:12345-192.168.204.59@tcp:37:lfs.0 Request processed in 11769us (12037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526858.899886:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1788526858.908766:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526858.908874:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012480 00000100:00100000:0.0:1788526858.908885:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012480 00000100:00100000:0.0:1788526858.908996:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1788526858.909008:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f6b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+11:14437:x1875405869012480:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1788526858.909254:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f6b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+12:14437:x1875405869012480:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 248us (500us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788526858.909262:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1788526858.983947:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526858.984275:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012608 00000100:00100000:2.0:1788526858.984286:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012608 00000100:00100000:2.0:1788526858.984362:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1788526858.984373:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+10:14443:x1875405869012608:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526858.984417:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526858.984440:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598b3 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984509:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984524:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984536:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984550:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984569:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984576:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984669:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8e00/0x367645d450b3b78c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984678:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8e00/0x367645d450b3b78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984685:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8e00/0x367645d450b3b78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526858.984712:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788526858.984715:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788526858.984768:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8e00/0x367645d450b3b78c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984781:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984789:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984795:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984802:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526858.984806:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984819:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984833:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:2.0:1788526858.984836:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526858.984840:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984965:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984981:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984987:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984994:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.984999:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1788526858.985002:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985008:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985015:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98c250b85900) 00010000:00010000:2.0:1788526858.985018:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788526858.985021:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985182:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8c00/0x367645d450b3b785 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985215:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598b3 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985229:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8e00/0x367645d450b3b78c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598b3 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526858.985237:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:2.0:1788526858.985239:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788526858.985243:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8e00, rc 0) 00000100:00100000:2.0:1788526858.985366:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+11:14443:x1875405869012608:12345-192.168.204.59@tcp:101:bash.0 Request processed in 994us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526858.985375:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1788526858.995333:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526858.995432:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012864 00000100:00100000:3.0:1788526858.995444:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012864 00000100:00100000:3.0:1788526858.995511:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1788526858.995522:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+11:14443:x1875405869012864:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1788526858.995543:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526858.995564:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b793 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598ba expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.995699:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.995714:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.995724:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.995760:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 11 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526858.995775:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 11 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526858.995789:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881591680:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526858.995890:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788526858.999950:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526859.000449:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869012992 00000100:00100000:0.0:1788526859.000460:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869012992 00010000:00010000:0.0:1788526859.000516:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 12 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526859.000569:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1788526859.000582:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+12:2349:x1875405869012992:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526859.000613:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526859.000622:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 12 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526859.000629:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c27477b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881591680:192.168.204.59@tcp:104: 00010000:00010000:0.0:1788526859.000640:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 12 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.000669:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b770 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ac expref: 12 pid: 14317 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.000673:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.000687:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:0.0:1788526859.000694:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.000706:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.000714:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.000740:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788526859.000771:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.000778:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526859.000791:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fda93c2-6592-4289-96e9-be3093fbc1e2+11:2349:x1875405869012992:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 212us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526859.000801:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00010000:00010000:3.0:1788526859.000805:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.000822:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.000836:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788526859.001225:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788526859.003858:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.003878:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.003890:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526859.003903:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788526859.003932:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004286:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004308:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004315:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e6200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526859.004320:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004328:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004357:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:3.0:1788526859.004360:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526859.004366:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004372:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6200/0x367645d450b3b79a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788526859.004423:0:14318:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b031403e reply state 00000000037f3f29 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526859.004433:0:14318:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788526859.004477:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e6800/0x367645d450b3b793 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 14 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004493:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 13 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.004500:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.004502:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788526859.004505:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55c00, rc 0) 00000100:00100000:3.0:1788526859.004574:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+14:14443:x1875405869012864:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9053us (9251us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788526859.004583:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00010000:00010000:3.0:1788526859.007757:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007778:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007804:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007811:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c2743e7400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526859.007816:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007824:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007839:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98c259884f00) 00010000:00010000:3.0:1788526859.007842:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526859.007846:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.007929:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c2743e7400/0x367645d450b3b7a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526859.028539:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.028642:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869013120 00000100:00100000:2.0:1788526859.028654:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869013120 00000100:00100000:2.0:1788526859.028736:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1788526859.028747:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+13:14443:x1875405869013120:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1788526859.028774:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526859.028796:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b7b6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598c1 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.028943:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.028969:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.028981:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526859.029020:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788526859.029024:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00080000:1.0:1788526859.029194:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788526859.029244:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.029256:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.029283:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9200/0x367645d450b3b7b6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.029314:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.029323:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:2.0:1788526859.029327:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526859.029331:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c8000, rc 0) 00000100:00100000:2.0:1788526859.029493:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14443:x1875405869013120:12345-192.168.204.59@tcp:101:bash.0 Request processed in 747us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526859.029500:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:1.0:1788526859.040608:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.040892:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869013376 00000100:00100000:3.0:1788526859.040903:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869013376 00000100:00100000:3.0:1788526859.041033:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1788526859.041046:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14443:x1875405869013376:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1788526859.041663:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+15:14443:x1875405869013376:12345-192.168.204.59@tcp:35:bash.0 Request processed in 617us (1063us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788526859.041671:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526859.158556:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.158664:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869013632 00000100:00100000:3.0:1788526859.158675:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869013632 00000100:00100000:3.0:1788526859.158737:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1788526859.158755:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+15:14453:x1875405869013632:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1788526859.158780:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526859.158805:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b7c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598c8 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526859.159022:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788526859.159230:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b7c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c8 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.159245:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98c250b85a00) 00010000:00010000:3.0:1788526859.159248:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526859.159254:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b7c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c8 expref: 17 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.159270:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55000, rc 0) 00000100:00100000:3.0:1788526859.159482:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+16:14453:x1875405869013632:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 728us (938us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788526859.159489:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1788526859.165249:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526859.165491:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869013888 00000100:00100000:0.0:1788526859.165502:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869013888 00000100:00100000:0.0:1788526859.165601:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1788526859.165613:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32158e92-3529-4d93-b45d-044ba1cc8762+16:14453:x1875405869013888:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1788526859.165903:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32158e92-3529-4d93-b45d-044ba1cc8762+17:14453:x1875405869013888:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 291us (662us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788526859.165912:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1788526859.242099:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.242136:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869014144 00000100:00100000:2.0:1788526859.242156:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869014144 00000100:00100000:2.0:1788526859.242215:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1788526859.242227:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+17:14456:x1875405869014144:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1788526859.242252:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526859.242273:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b7d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598cf expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.242411:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b7d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.242427:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.242439:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526859.242451:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788526859.242576:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b7d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598cf expref: 20 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.242594:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598cf expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.242602:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:2.0:1788526859.242604:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526859.242607:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c9e00, rc 0) 00000100:00100000:2.0:1788526859.242675:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+19:14456:x1875405869014144:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 449us (586us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788526859.242681:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1788526859.248695:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.248728:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869014272 00000100:00100000:3.0:1788526859.248737:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869014272 00000100:00100000:3.0:1788526859.248794:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526859.248804:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+19:2349:x1875405869014272:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788526859.248819:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526859.248844:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b7d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598cf expref: 19 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.248877:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.248882:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526859.248932:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+18:2349:x1875405869014272:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.248941:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526859.249528:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.249631:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869014400 00000100:00100000:3.0:1788526859.249637:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869014400 00000100:00100000:3.0:1788526859.249682:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1788526859.249690:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+18:14456:x1875405869014400:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1788526859.250690:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250712:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250723:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250749:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250755:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250762:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250767:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526859.250783:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250792:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250806:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.250809:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788526859.250814:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.250822:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b7e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526859.250891:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+18:14456:x1875405869014400:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 1199us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.250900:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1788526859.259243:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526859.260481:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869014656 00000100:00100000:1.0:1788526859.260494:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869014656 00000100:00100000:1.0:1788526859.260552:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526859.260563:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+18:14456:x1875405869014656:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1788526859.260783:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+19:14456:x1875405869014656:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 221us (1550us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788526859.260791:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000040:00080000:0.0:1788526859.348662:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788526859.653889:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.654692:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869014912 00000100:00100000:2.0:1788526859.654705:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869014912 00000100:00100000:2.0:1788526859.654830:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1788526859.654841:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+19:14487:x1875405869014912:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1788526859.654868:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788526859.654892:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b7ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598d6 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.655032:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b7f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.655048:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.655059:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b7f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788526859.655071:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788526859.655241:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8800/0x367645d450b3b7ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598d6 expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.655260:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b7f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598d6 expref: 21 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.655268:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:2.0:1788526859.655271:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788526859.655274:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c1423c9a00, rc 0) 00000100:00100000:2.0:1788526859.655376:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+21:14487:x1875405869014912:12345-192.168.204.59@tcp:101:cat.0 Request processed in 534us (1494us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788526859.655450:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1788526859.677827:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526859.677996:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.678766:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869015296 00000100:00100000:2.0:1788526859.678783:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869015296 00000100:00100000:2.0:1788526859.678854:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1788526859.678866:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:14487:x1875405869015296:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:2.0:1788526859.679312:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+22:14487:x1875405869015296:12345-192.168.204.59@tcp:35:cat.0 Request processed in 438us (1305us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788526859.679321:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1788526859.681641:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869015040 00000100:00100000:0.0:1788526859.681657:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869015040 00000100:00100000:0.0:1788526859.681804:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526859.681815:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32158e92-3529-4d93-b45d-044ba1cc8762+22:2348:x1875405869015040:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526859.681830:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526859.681857:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b7f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598d6 expref: 22 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.681878:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:0.0:1788526859.681884:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526859.681962:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:2348:x1875405869015040:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 149us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526859.681971:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1788526859.731748:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881591808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788526859.731854:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526859.732448:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591808 00000100:00100000:3.0:1788526859.732458:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591808 00000100:00100000:3.0:1788526859.732535:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788526859.732545:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881591808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788526859.732585:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526859.732642:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881591808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.732649:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788526859.732789:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788526859.732858:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881591808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788526859.733736:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788526859.733789:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526859.733817:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788526859.733823:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788526859.733866:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526859.733899:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881592192 00000100:00100000:0.0:1788526859.733904:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881592192 00000100:00100000:0.0:1788526859.733949:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881592320 00000100:00100000:0.0:1788526859.733952:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881592320 00000100:00100000:0.0:1788526859.734004:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788526859.734011:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881592192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526859.734074:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875405881592192:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526859.734081:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788526859.734118:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875405881592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788526859.734152:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788526859.734159:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526859.734194:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875405881592320:12345-0@lo:400:kworker.0 Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526859.734200:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788526859.734222:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3278:1875405881592320:0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735163:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881591936:0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735219:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526859.735262:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881592448:0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735311:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526859.735332:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526859.735339:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881592064:0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735364:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526859.735418:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881592064 00000100:00100000:3.0:1788526859.735423:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881592064 00000100:00100000:3.0:1788526859.735459:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526859.735466:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735504:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881592064:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.735510:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788526859.735542:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881592064:0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735560:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881592448 00000100:00100000:3.0:1788526859.735562:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881592448 00000100:00100000:3.0:1788526859.735584:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526859.735589:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526859.735619:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881592448:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.735625:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788526859.735646:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881592448:0@lo:400:kworker.0 00000100:00100000:2.0:1788526859.735769:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881591936 00000100:00100000:2.0:1788526859.735774:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881591936 00000100:00100000:2.0:1788526859.735806:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788526859.735812:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881591936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788526859.735858:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881591936:12345-0@lo:400:kworker.0 Request processed in 46us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526859.735864:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788526859.736358:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881591936:0@lo:400:kworker.0 00000100:00080000:1.0:1788526859.736529:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526859.752578:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.752676:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869015552 00000100:00100000:3.0:1788526859.752688:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869015552 00000100:00100000:3.0:1788526859.752783:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1788526859.752795:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+21:14493:x1875405869015552:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1788526859.752839:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526859.752862:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b803 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598dd expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753001:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753017:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753026:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753035:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753072:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753086:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 22 pid: 14316 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526859.753102:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881592576:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526859.753212:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.753221:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526859.753242:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881592704:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526859.753268:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788526859.757441:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526859.757637:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b49880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881592576:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526859.757651:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881592704:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526859.757678:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526859.757947:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869015680 00000100:00100000:2.0:1788526859.757955:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869015680 00010000:00010000:2.0:1788526859.758167:0:14302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 23 pid: 14316 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526859.758209:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1788526859.758220:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c2451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+23:2349:x1875405869015680:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526859.758237:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526859.758244:0:14302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 23 pid: 14316 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.758278:0:14302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 23 pid: 14316 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.758315:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b7bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598c1 expref: 23 pid: 14316 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.758332:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:2.0:1788526859.758338:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.758346:0:14302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.758353:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526859.758442:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c2451fc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+22:2349:x1875405869015680:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 223us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526859.758450:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1788526859.761766:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.762240:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869015808 00000100:00100000:2.0:1788526859.762251:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869015808 00010000:00010000:2.0:1788526859.762304:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526859.762352:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1788526859.762363:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32158e92-3529-4d93-b45d-044ba1cc8762+22:2349:x1875405869015808:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526859.762377:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526859.763475:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763513:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763538:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55c00/0x367645d450b3b7a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598ba expref: 22 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763555:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:2.0:1788526859.763560:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763570:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763578:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.763604:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526859.763668:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32158e92-3529-4d93-b45d-044ba1cc8762+21:2349:x1875405869015808:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1307us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526859.763677:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00010000:00010000:1.0:1788526859.764722:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526859.764736:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526859.764759:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788526859.767795:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54c00/0x367645d450b3b803 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598dd expref: 22 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526859.767852:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55000/0x367645d450b3b80a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598dd expref: 21 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526859.767885:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:1.0:1788526859.767889:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788526859.767895:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55000, rc 0) 00000100:00100000:1.0:1788526859.768011:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+21:14493:x1875405869015552:12345-192.168.204.59@tcp:101:dd.0 Request processed in 15215us (15443us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788526859.768023:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:0.0:1788526859.777807:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.777888:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016064 00000100:00100000:2.0:1788526859.777898:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016064 00000100:00100000:2.0:1788526859.777988:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1788526859.777999:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:14493:x1875405869016064:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:2.0:1788526859.778600:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.778624:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.778654:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526859.778732:0:14316:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788526859.778769:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c1fbd03 reply state 00000000624a8c15 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526859.778780:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788526859.778902:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+24:14493:x1875405869016064:12345-192.168.204.59@tcp:36:dd.0 Request processed in 901us (1102us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788526859.778909:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000020:00080000:2.0:1788526859.778914:0:14316:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788526859.784244:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784262:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784270:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784276:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526859.784294:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784302:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784321:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.784324:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526859.784329:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.784335:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8000/0x367645d450b3b818 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526859.785621:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526859.786843:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016192 00000100:00100000:0.0:1788526859.786858:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016192 00000100:00100000:0.0:1788526859.786934:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1788526859.786945:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+23:14493:x1875405869016192:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:0.0:1788526859.786971:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526859.787002:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b81f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598e4 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.787066:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b81f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598e4 expref: 24 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.787082:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b81f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598e4 expref: 24 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526859.787119:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:0.0:1788526859.787123:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788526859.787127:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820800, rc 0) 00000100:00100000:0.0:1788526859.787214:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+24:14493:x1875405869016192:12345-192.168.204.59@tcp:101:dd.0 Request processed in 271us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526859.787221:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:2.0:1788526859.811824:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.811917:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016448 00000100:00100000:3.0:1788526859.811937:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016448 00000100:00100000:3.0:1788526859.812064:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1788526859.812077:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+24:14493:x1875405869016448:12345-192.168.204.59@tcp:103:dd.0 00010000:00010000:3.0:1788526859.812093:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788526859.812123:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820800/0x367645d450b3b81f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598e4 expref: 24 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.812337:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.812342:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788526859.812454:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32158e92-3529-4d93-b45d-044ba1cc8762+23:14493:x1875405869016448:12345-192.168.204.59@tcp:103:dd.0 Request processed in 379us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.812462:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1788526859.824650:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526859.825948:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016576 00000100:00100000:2.0:1788526859.825961:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016576 00000100:00100000:2.0:1788526859.826048:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1788526859.826060:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+23:14493:x1875405869016576:12345-192.168.204.59@tcp:58:dd.0 00010000:00010000:2.0:1788526859.826522:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.826542:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526859.826554:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526859.829325:0:14316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788526859.830944:0:14316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788526859.831682:0:14316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788526859.831843:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+23:14493:x1875405869016576:12345-192.168.204.59@tcp:58:dd.0 Request processed in 5779us (7198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526859.831858:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1788526859.836891:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526859.836994:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016704 00000100:00100000:3.0:1788526859.837004:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016704 00000100:00100000:3.0:1788526859.837067:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1788526859.837078:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+23:14493:x1875405869016704:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:3.0:1788526859.837101:0:14317:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526859.837123:0:14317:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598eb expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837312:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837326:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 24 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837346:0:14317:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837373:0:14317:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 24 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837417:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526859.837421:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526859.837425:0:14317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 24 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526859.837433:0:14317:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55e00, rc 0) 00000100:00100000:3.0:1788526859.837504:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+24:14493:x1875405869016704:12345-192.168.204.59@tcp:101:dd.0 Request processed in 429us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526859.837510:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000001:00080000:0.0:1788526859.843812:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:0.0:1788526859.843827:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788526859.843835:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1788526859.843841:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00010000:00010000:3.0:1788526859.927325:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788526860.374044:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788526860.374056:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788526860.374099:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788526860.374106:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788526860.374236:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1875405881592832:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788526860.375231:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c249d88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788526860.381717:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526860.382427:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14348:1875405881592832:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788526860.382744:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016832 00000100:00100000:3.0:1788526860.382753:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016832 00000100:00100000:3.0:1788526860.382813:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1788526860.382823:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869016832:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788526860.382942:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869016832:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 119us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526860.382950:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1788526860.391462:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.391614:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869016960 00000100:00100000:0.0:1788526860.391625:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869016960 00000100:00100000:0.0:1788526860.391692:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1788526860.391704:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869016960:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788526860.391741:0:14316:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788526860.391890:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869016960:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 188us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.391906:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1788526860.397479:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526860.406096:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869017088 00000100:00100000:3.0:1788526860.406113:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869017088 00000100:00100000:3.0:1788526860.406191:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1788526860.406205:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869017088:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788526860.406295:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406330:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406342:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406360:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406367:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406373:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406445:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406454:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406462:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788526860.406504:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788526860.406508:0:14317:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788526860.406525:0:14317:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406537:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406552:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406559:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406564:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.406569:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406577:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406590:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c250b85e00) 00010000:00010000:3.0:1788526860.406594:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526860.406599:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406605:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54400/0x367645d450b3b834 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406621:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406627:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406632:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406638:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b54a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.406647:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406653:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406661:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98c259884f00) 00010000:00010000:3.0:1788526860.406663:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526860.406666:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406672:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b54a00/0x367645d450b3b83b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406686:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406692:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406698:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406704:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c242b55a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.406706:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406711:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406718:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526860.406721:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526860.406730:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.406736:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55a00/0x367645d450b3b842 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526860.408325:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869017088:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 2111us (10845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526860.408340:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:2.0:1788526860.419583:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.419694:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869017344 00000100:00100000:1.0:1788526860.419707:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869017344 00000100:00100000:1.0:1788526860.419768:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1788526860.419778:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869017344:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.419799:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526860.419823:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b849 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598f2 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.419952:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.419971:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.419993:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788526860.420006:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788526860.420127:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420135:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420153:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420160:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526860.420165:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420173:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420185:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:1.0:1788526860.420188:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526860.420192:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420198:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b850 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420243:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b849 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598f2 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420254:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98c250b85e00) 00010000:00010000:1.0:1788526860.420256:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788526860.420260:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b849 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598f2 expref: 16 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.420281:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111c00, rc 0) 00000100:00100000:1.0:1788526860.420354:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+15:14494:x1875405869017344:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 578us (785us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788526860.420371:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1788526860.425524:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526860.425613:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869017472 00000100:00100000:3.0:1788526860.425623:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869017472 00000100:00100000:3.0:1788526860.425684:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:3.0:1788526860.425694:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+15:14494:x1875405869017472:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788526860.425734:0:14317:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788526860.427143:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+15:14494:x1875405869017472:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 1438us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526860.427156:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1788526860.435232:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.435382:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869017728 00000100:00100000:0.0:1788526860.435425:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869017728 00000100:00100000:0.0:1788526860.435479:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1788526860.435490:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+15:14494:x1875405869017728:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526860.435514:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526860.435538:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b85e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc598f9 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788526860.442727:0:14316:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1788526860.442744:0:14316:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788526860.442803:0:14316:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788526860.443182:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b865 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.443201:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.443214:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b865 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.443301:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b85e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598f9 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.443322:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b865 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598f9 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.443344:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972700) 00010000:00010000:0.0:1788526860.443347:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788526860.443350:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820000, rc 0) 00000100:00100000:0.0:1788526860.443508:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+17:14494:x1875405869017728:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 8018us (8286us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788526860.443517:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1788526860.456066:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.459191:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869017984 00000100:00100000:0.0:1788526860.459210:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869017984 00000100:00100000:1.0:1788526860.464225:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1788526860.464242:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+17:14494:x1875405869017984:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.464320:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526860.464355:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b865 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598f9 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464382:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972700) 00010000:00010000:1.0:1788526860.464438:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526860.464465:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464482:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464493:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464507:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464514:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464519:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464771:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464791:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464800:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464805:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526860.464810:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464818:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464836:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98c243972500) 00010000:00010000:1.0:1788526860.464839:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526860.464843:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464848:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b873 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464857:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464863:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464869:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464875:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526860.464884:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464891:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464899:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x861f930d (ffff98c272284c00) 00010000:00010000:1.0:1788526860.464902:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788526860.464904:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.464910:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b87a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x861f930d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.465175:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+16:14494:x1875405869017984:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 935us (9117us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788526860.465184:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1788526860.478377:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.479326:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869018112 00000100:00100000:0.0:1788526860.479343:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869018112 00000100:00100000:0.0:1788526860.479467:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1788526860.479479:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+16:14494:x1875405869018112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526860.479502:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526860.479528:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b881 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59900 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479567:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3b888 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479583:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3b888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479594:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3b888 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479709:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b881 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59900 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479744:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821200/0x367645d450b3b888 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59900 expref: 17 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.479753:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:0.0:1788526860.479756:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788526860.479760:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821200, rc 0) 00000100:00100000:0.0:1788526860.479836:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+17:14494:x1875405869018112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 360us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.479844:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1788526860.483695:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.485126:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869018368 00000100:00100000:1.0:1788526860.485142:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869018368 00000100:00100000:1.0:1788526860.485219:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1788526860.485230:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+17:14494:x1875405869018368:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.485334:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.485353:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.485365:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788526860.485842:0:14317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788526860.485869:0:14317:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495826481491ns, next at 496826479504ns, rc = 0 00000004:00010000:1.0:1788526860.487261:0:14317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e485685e reply state 0000000045feb052 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.487291:0:14317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526860.487657:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+19:14494:x1875405869018368:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 2424us (3969us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788526860.487678:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:1.0:1788526860.491610:0:3265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491631:0:3265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491640:0:3265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491647:0:3265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1788526860.491653:0:3265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491661:0:3265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491690:0:3265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:1.0:1788526860.491694:0:3265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788526860.491699:0:3265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.491706:0:3265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111200/0x367645d450b3b88f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.492771:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.492994:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869018496 00000100:00100000:1.0:1788526860.493007:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869018496 00000100:00100000:1.0:1788526860.493187:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1788526860.493198:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+18:14494:x1875405869018496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.493225:0:14318:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788526860.493246:0:14318:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59907 expref: -99 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.493322:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.493338:0:14318:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 19 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.493369:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:1.0:1788526860.493373:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788526860.493376:0:14318:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c245111c00, rc 0) 00000100:00100000:1.0:1788526860.493486:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+19:14494:x1875405869018496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 289us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526860.493494:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:2.0:1788526860.497469:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526860.497748:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869018624 00000100:00100000:3.0:1788526860.497759:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869018624 00000100:00100000:3.0:1788526860.497834:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526860.497845:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869018624:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788526860.498181:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526860.498561:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+6:2348:x1875405869018624:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 716us (1104us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788526860.498570:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526860.503652:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526860.503864:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869018880 00000100:00100000:2.0:1788526860.503875:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869018880 00000100:00100000:2.0:1788526860.503955:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1788526860.503965:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+19:14494:x1875405869018880:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788526860.504378:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+20:14494:x1875405869018880:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 413us (736us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788526860.504415:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1788526860.508575:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.508722:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019136 00000100:00100000:1.0:1788526860.508733:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019136 00000100:00100000:1.0:1788526860.508843:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:1.0:1788526860.508854:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+20:14494:x1875405869019136:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788526860.508997:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+20:14494:x1875405869019136:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 145us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526860.509019:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1788526860.512139:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.513180:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019264 00000100:00100000:0.0:1788526860.513193:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019264 00000100:00100000:0.0:1788526860.513243:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:0.0:1788526860.513251:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+20:14494:x1875405869019264:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526860.513280:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526860.513301:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821c00/0x367645d450b3b89d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5990e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513368:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513407:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513419:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788526860.513453:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788526860.513486:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513512:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821c00/0x367645d450b3b89d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5990e expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513529:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5990e expref: 21 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.513539:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:0.0:1788526860.513541:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788526860.513545:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e820e00, rc 0) 00000100:00100000:0.0:1788526860.513619:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:14494:x1875405869019264:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 368us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.513626:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1788526860.516883:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.517593:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019392 00000100:00100000:0.0:1788526860.517605:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019392 00000100:00100000:0.0:1788526860.517656:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1788526860.517665:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+6:2348:x1875405869019392:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788526860.517683:0:16195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788526860.517704:0:16195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc59915 expref: -99 pid: 16195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788526860.517731:0:16195:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ac10b, blocks: 0x1 00010000:00010000:0.0:1788526860.517751:0:16195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788526860.517756:0:16195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526860.517766:0:16195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 7 pid: 16195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.517810:0:16195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 7 pid: 16195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.517824:0:16195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c26e821a00, rc 0) 00000100:00100000:0.0:1788526860.517887:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+7:2348:x1875405869019392:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 224us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.517909:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1788526860.522005:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.522183:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019648 00000100:00100000:0.0:1788526860.522195:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019648 00000100:00100000:0.0:1788526860.522262:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:0.0:1788526860.522282:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:14494:x1875405869019648:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788526860.522442:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32158e92-3529-4d93-b45d-044ba1cc8762+21:14494:x1875405869019648:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 162us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.522451:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1788526860.526142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526860.526496:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019776 00000100:00100000:2.0:1788526860.526507:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019776 00000100:00100000:2.0:1788526860.526588:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1788526860.526598:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+21:14494:x1875405869019776:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788526860.569042:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+21:14494:x1875405869019776:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 42433us (42899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526860.569057:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000001:00080000:3.0:1788526860.569220:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1788526860.569249:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788526860.569253:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788526860.569288:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1788526860.569605:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881592960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788526860.569686:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526860.570044:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881592960 00000100:00100000:1.0:1788526860.570053:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881592960 00000100:00100000:1.0:1788526860.570185:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788526860.570195:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875405881592960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788526860.570366:0:15003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788526860.570370:0:15003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788526860.570373:0:15003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788526860.570375:0:15003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788526859 -> 1788526859 00002000:00010000:1.0:1788526860.570377:0:15003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788526860.570658:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875405881592960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 464us (971us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788526860.570666:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788526860.570751:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98c26e811500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788526860.570758:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3281:1875405881592960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788526860.573548:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.573634:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869019904 00000100:00100000:0.0:1788526860.573644:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869019904 00000100:00100000:0.0:1788526860.573699:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526860.573709:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+7:2349:x1875405869019904:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788526860.573827:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+7:2349:x1875405869019904:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.573835:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1788526860.581138:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.581320:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020160 00000100:00100000:1.0:1788526860.581333:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020160 00000100:00100000:1.0:1788526860.581445:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1788526860.581456:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869020160:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.581526:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788526860.581566:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820e00/0x367645d450b3b8a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5990e expref: 14 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.581591:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:1.0:1788526860.581597:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788526860.581662:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.581682:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.581696:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788526860.581898:0:14317:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b315535b reply state 0000000002170587 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.581908:0:14317:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788526860.582027:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32158e92-3529-4d93-b45d-044ba1cc8762+15:14494:x1875405869020160:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 572us (899us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788526860.582034:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00010000:00010000:3.0:1788526860.584819:0:3264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584838:0:3264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584847:0:3264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584853:0:3264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.584858:0:3264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584867:0:3264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584884:0:3264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:3.0:1788526860.584888:0:3264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788526860.584893:0:3264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.584899:0:3264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111e00/0x367645d450b3b8b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526860.589017:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526860.589334:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020288 00000100:00100000:3.0:1788526860.589346:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020288 00000100:00100000:3.0:1788526860.589436:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1788526860.589446:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:14494:x1875405869020288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788526860.589466:0:15000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788526860.589485:0:15000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c942530fbc5991c expref: -99 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.589518:0:15000:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.589527:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526860.589531:0:15000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788526860.589535:0:15000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.589569:0:15000:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.589584:0:15000:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526860.589599:0:15000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245223800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15000:1875405881593088:192.168.204.59@tcp:104: 00000100:00100000:3.0:1788526860.589690:0:15000:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526860.593957:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526860.594068:0:15000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245223800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15000:1875405881593088:192.168.204.59@tcp:104: 00010000:00010000:3.0:1788526860.594115:0:15000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.594136:0:15000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98c242b55a00, rc 0) 00000100:00100000:3.0:1788526860.594197:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32158e92-3529-4d93-b45d-044ba1cc8762+8:14494:x1875405869020288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 4752us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526860.594206:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1788526860.594865:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020416 00000100:00100000:2.0:1788526860.594875:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020416 00010000:00010000:2.0:1788526860.594922:0:14303:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.594952:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1788526860.594963:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32158e92-3529-4d93-b45d-044ba1cc8762+8:2349:x1875405869020416:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788526860.594977:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788526860.595006:0:14303:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.595020:0:14303:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.595045:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59915 expref: 8 pid: 16195 timeout: 595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.595061:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526860.595065:0:14303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526860.595072:0:14303:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.595094:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.595152:0:14303:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 7 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.595166:0:14303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14303:1875405881593216:192.168.204.59@tcp:105: 00000100:00100000:2.0:1788526860.595238:0:14303:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526860.600646:0:14303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14303:1875405881593216:192.168.204.59@tcp:105: 00010000:00010000:2.0:1788526860.600682:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788526860.600745:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32158e92-3529-4d93-b45d-044ba1cc8762+7:2349:x1875405869020416:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 5783us (6796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526860.600756:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1788526860.604288:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.604417:0:16195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020544 00000100:00100000:0.0:1788526860.604429:0:16195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020544 00000100:00100000:0.0:1788526860.604492:0:16195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:0.0:1788526860.604504:0:16195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+7:2348:x1875405869020544:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788526860.604749:0:16195:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788526860.604753:0:16195:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788526859 00002000:00010000:0.0:1788526860.604755:0:16195:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788526858 00002000:00010000:0.0:1788526860.604757:0:16195:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788526859 -> 1788526859 00002000:00010000:0.0:1788526860.604760:0:16195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788526860.604836:0:16195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32158e92-3529-4d93-b45d-044ba1cc8762+8:2348:x1875405869020544:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 334us (571us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788526860.604844:0:16195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:0.0:1788526860.608064:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.608243:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020672 00000100:00100000:1.0:1788526860.608253:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020672 00000100:00100000:1.0:1788526860.608362:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1788526860.608372:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+8:2350:x1875405869020672:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788526860.608469:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.608494:0:15003:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.608502:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526860.608506:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788526860.608526:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.608564:0:15003:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.608579:0:15003:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.608594:0:15003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15003:1875405881593344:192.168.204.59@tcp:104: 00000100:00100000:1.0:1788526860.608686:0:15003:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250bcce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788526860.612723:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.612808:0:14750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869020800 00000100:00100000:0.0:1788526860.612820:0:14750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869020800 00010000:00010000:0.0:1788526860.612867:0:14750:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 9 pid: 15000 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526860.612918:0:14750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1788526860.612929:0:14750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32158e92-3529-4d93-b45d-044ba1cc8762+9:2349:x1875405869020800:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526860.612945:0:14750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526860.612972:0:14750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 9 pid: 15000 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.612986:0:14750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 9 pid: 15000 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.613041:0:14750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526860.613047:0:14750:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788526860.613054:0:14750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.613065:0:14750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.613219:0:14750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526860.613293:0:14750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32158e92-3529-4d93-b45d-044ba1cc8762+9:2349:x1875405869020800:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 365us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.613300:0:14750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:2.0:1788526860.614990:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b1d840/0x367645d450b3b8b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc5991c expref: 8 pid: 15000 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.615015:0:15003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15003:1875405881593344:192.168.204.59@tcp:104: 00010000:00010000:2.0:1788526860.615248:0:15003:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.615261:0:15003:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.615926:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616009:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616019:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616038:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616046:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526860.616051:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616059:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616080:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.616098:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b8c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.616226:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32158e92-3529-4d93-b45d-044ba1cc8762+7:2350:x1875405869020672:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 7852us (8170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526860.616245:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1788526860.620366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526860.620533:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021056 00000100:00100000:2.0:1788526860.620544:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021056 00000100:00100000:2.0:1788526860.620607:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1788526860.620617:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+14:14494:x1875405869021056:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788526860.620711:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.620729:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.620741:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.621060:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.621072:0:14318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.621082:0:14318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.621125:0:14318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 15 pid: 14318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.621139:0:14318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 15 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526860.621170:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881593472:192.168.204.59@tcp:104: 00000100:00100000:2.0:1788526860.621424:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24554f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788526860.625675:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.625736:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021184 00000100:00100000:0.0:1788526860.625746:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021184 00010000:00010000:0.0:1788526860.625794:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 16 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526860.625862:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1788526860.625871:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32158e92-3529-4d93-b45d-044ba1cc8762+16:2348:x1875405869021184:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788526860.625892:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788526860.625900:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 16 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.625923:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 16 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.625967:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:0.0:1788526860.625972:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.625981:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.625989:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.626006:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788526860.626065:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32158e92-3529-4d93-b45d-044ba1cc8762+16:2348:x1875405869021184:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 195us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.626072:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:1.0:1788526860.626126:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c245111c00/0x367645d450b3b896 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x4c942530fbc59907 expref: 15 pid: 14318 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.626143:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e4d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881593472:192.168.204.59@tcp:104: 00010000:00010000:1.0:1788526860.626165:0:14318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.626174:0:14318:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.626180:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526860.626367:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788526860.626540:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788526860.626589:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788526860.626674:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1875405881593600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788526860.626727:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526860.626752:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c24a3666c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526860.626843:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881593600 00000100:00100000:3.0:1788526860.626849:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881593600 00000100:00100000:3.0:1788526860.626885:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788526860.626892:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875405881593600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788526860.626961:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875405881593600:12345-0@lo:1000:mdt00_002.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526860.626968:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788526860.627362:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1875405881593600:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788526860.628888:0:14318:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788526860.629218:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1875405881593728:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788526860.629290:0:14318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788526860.629479:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c250bcce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788526860.638164:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881593728 00000100:00100000:3.0:1788526860.638181:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881593728 00000100:00100000:2.0:1788526860.640624:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788526860.640645:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14318:x1875405881593728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788526860.640977:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14318:x1875405881593728:12345-0@lo:1000:mdt00_002.0 Request processed in 339us (11685us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788526860.640986:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788526860.641107:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26e813480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14318:1875405881593728:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788526860.641155:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641166:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641174:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641203:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.641208:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641218:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641236:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:3.0:1788526860.641239:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526860.641245:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641252:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9e00/0x367645d450b3b8ce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641303:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641310:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641316:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641322:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c8200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1788526860.641325:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641331:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641352:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:3.0:1788526860.641354:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788526860.641363:0:14318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641375:0:14318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641428:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526860.641496:0:14318:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98c242b55e00/0x367645d450b3b82d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x4c942530fbc598eb expref: 18 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526860.641512:0:14318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c245222a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881593856:192.168.204.59@tcp:105: 00000100:00100000:3.0:1788526860.641604:0:14318:0:(client.c:2716:ptlrpc_set_wait()) set ffff98c2450d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788526860.648426:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.648543:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021312 00000100:00100000:0.0:1788526860.648556:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021312 00000100:00100000:0.0:1788526860.648618:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1788526860.648629:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27f6b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+19:14493:x1875405869021312:12345-192.168.204.59@tcp:49:dd.0 00000100:00100000:0.0:1788526860.648802:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27f6b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+19:14493:x1875405869021312:12345-192.168.204.59@tcp:49:dd.0 Request processed in 175us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526860.648810:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1788526860.653015:0:14318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c245222a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14318:1875405881593856:192.168.204.59@tcp:105: 00010000:00010000:1.0:1788526860.653062:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.653075:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c8200/0x367645d450b3b826 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653374:0:14318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653519:0:14318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653532:0:14318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653558:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653565:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653572:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653578:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526860.653582:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653589:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653600:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:0.0:1788526860.653603:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788526860.653607:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653612:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e821a00/0x367645d450b3b8d5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653622:0:14318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653628:0:14318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653634:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653643:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1788526860.653646:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653652:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653659:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98c259884600) 00010000:00010000:0.0:1788526860.653661:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788526860.653664:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.653668:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c1423c9a00/0x367645d450b3b8c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14318 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788526860.655228:0:14348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788526860.655238:0:14348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788526860.655304:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788526860.655309:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788526860.655620:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+18:14494:x1875405869021056:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 34996us (35259us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788526860.655633:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000020:00080000:0.0:1788526860.655639:0:14318:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788526860.661579:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.661688:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021568 00000100:00100000:0.0:1788526860.661702:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021568 00000100:00100000:0.0:1788526860.661774:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1788526860.661787:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+18:14494:x1875405869021568:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788526860.665019:0:14319:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788526860.665166:0:14319:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788526860.665235:0:14319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665254:0:14319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665289:0:14319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665298:0:14319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665305:0:14319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665312:0:14319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.665334:0:14319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788526860.665499:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32158e92-3529-4d93-b45d-044ba1cc8762+20:14494:x1875405869021568:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 3709us (3926us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788526860.665510:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000020:00080000:0.0:1788526860.665516:0:14319:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788526860.666704:0:14305:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788526860.666716:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.666726:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820000 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526860.666730:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.666740:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.666756:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98c243972e00) 00010000:00010000:2.0:1788526860.666759:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788526860.666764:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.666787:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98c26e820000/0x367645d450b3b8dc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14319 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526860.666802:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526860.666804:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788526860.666806:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788526860.864443:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526860.864488:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526860.864838:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021696 00000100:00100000:0.0:1788526860.864851:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021696 00000100:00100000:0.0:1788526860.864927:0:15006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021952 00000100:00100000:0.0:1788526860.864931:0:15006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021952 00000100:00100000:0.0:1788526860.864953:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1788526860.864967:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+8:2351:x1875405869021696:12345-192.168.204.59@tcp:4:dd.0 00002000:00010000:0.0:1788526860.865032:0:15006:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9ac10b, atime: 0x6a9ac10a, ctime: 0x6a9ac10b, blocks: 0x1 00010000:00010000:0.0:1788526860.865043:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.865062:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=496s v=(0 0) 00010000:00010000:0.0:1788526860.865239:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526860.865247:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526860.865276:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526860.866340:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526860.866648:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788526860.866666:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788526860.868609:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869021824 00000100:00100000:3.0:1788526860.868623:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869021824 00000100:00100000:1.0:1788526860.869229:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1788526860.869243:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+9:2351:x1875405869021952:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:1.0:1788526860.869293:0:16549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.869313:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526860.869318:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526860.869326:0:16549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.869350:0:16549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526860.951637:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788526861.049482:0:16549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1788526861.049493:0:16549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1788526861.049507:0:16549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049520:0:16549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049529:0:16549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049536:0:16549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526861.049541:0:16549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049550:0:16549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049572:0:16549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049596:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000092e8fde/0x367645d450b3b8ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526861.049683:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+14:2351:x1875405869021952:12345-192.168.204.59@tcp:4:dd.0 Request processed in 180439us (185189us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788526861.049692:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1788526861.049834:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1788526861.049847:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+13:2351:x1875405869021824:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:0.0:1788526861.049881:0:16549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049893:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526861.049897:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526861.049902:0:16549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.049914:0:16549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526861.054370:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1788526861.054414:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1788526861.054424:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:3.0:1788526861.054430:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1788526861.057769:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526861.057799:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526861.057822:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1788526861.058939:0:15008:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788526861.058953:0:15008:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788526861.058983:0:15007:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788526861.059006:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022080 00000100:00100000:3.0:1788526861.059017:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022080 00000100:00100000:3.0:1788526861.059351:0:15007:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788526861.059359:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022336 00000100:00100000:3.0:1788526861.059362:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022336 00000100:00100000:3.0:1788526861.059376:0:15007:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788526861.059380:0:15007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022208 00000100:00100000:3.0:1788526861.059383:0:15007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022208 00000100:00100000:1.0:1788526861.080485:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1788526861.080517:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:32158e92-3529-4d93-b45d-044ba1cc8762+13:2350:x1875405869022080:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:1.0:1788526861.080571:0:16552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.080592:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.080596:0:16552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.080603:0:16552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.080618:0:16552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788526861.159067:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1788526861.171158:0:15006:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1788526861.171170:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1788526861.171186:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171200:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171233:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171240:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526861.171244:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171264:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171284:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171292:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e310e9/0x367645d450b3b8e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526861.171592:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+15:2351:x1875405869021696:12345-192.168.204.59@tcp:4:dd.0 Request processed in 306622us (307206us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788526861.171602:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1788526861.171654:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1788526861.171668:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26e4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+14:2350:x1875405869022336:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:0.0:1788526861.171709:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171723:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526861.171737:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788526861.171746:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.171759:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788526861.237342:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1788526861.237715:0:16549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1788526861.237721:0:16549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:3.0:1788526861.237736:0:16552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.237754:0:16552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.237764:0:16552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239210:0:16549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239228:0:16549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.239268:0:16552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111e00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526861.239275:0:16552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.239288:0:16552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.239311:0:16552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.239320:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd95089/0x367645d450b3b8f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239568:0:16549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239577:0:16549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e821c00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526861.239580:0:16549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239589:0:16549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239609:0:16549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.239617:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009983339b/0x367645d450b3b8f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526861.239755:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+11:2351:x1875405869021824:12345-192.168.204.59@tcp:4:dd.0 Request processed in 189908us (373414us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788526861.239766:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1788526861.239807:0:16549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1788526861.239820:0:16549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+10:2350:x1875405869022208:12345-192.168.204.59@tcp:4:dd.0 00000100:00100000:3.0:1788526861.240184:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:32158e92-3529-4d93-b45d-044ba1cc8762+10:2350:x1875405869022080:12345-192.168.204.59@tcp:4:dd.0 Request processed in 159679us (182426us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788526861.240192:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00010000:00010000:2.0:1788526861.240535:0:16549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.240550:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526861.240554:0:16549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788526861.240559:0:16549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.240571:0:16549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788526861.281919:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1788526861.284757:0:15006:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1788526861.284786:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284815:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284825:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284833:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c26e820600 already unused, calling callback (ffffffffc1554660) 00010000:00010000:2.0:1788526861.284839:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284849:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284872:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788526861.284880:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4ae119/0x367645d450b3b8ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788526861.284987:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26e4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+9:2350:x1875405869022336:12345-192.168.204.59@tcp:4:dd.0 Request processed in 113319us (227182us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788526861.284998:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1788526861.291679:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1788526861.291722:0:3272:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1788526861.291795:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022464 00000100:00100000:1.0:1788526861.291809:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022464 00000100:00100000:1.0:1788526861.291888:0:15008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022592 00000100:00100000:1.0:1788526861.291892:0:15008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022592 00000100:00100000:1.0:1788526861.291930:0:15008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1788526861.291941:0:15008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:32158e92-3529-4d93-b45d-044ba1cc8762+10:2348:x1875405869022464:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:1.0:1788526861.291981:0:15008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.292016:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.292020:0:15008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.292028:0:15008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.292042:0:15008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526861.292292:0:15006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1788526861.292302:0:15006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+11:2349:x1875405869022592:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:1.0:1788526861.292319:0:15006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.292330:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.292334:0:15006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788526861.292339:0:15006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.292349:0:15006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788526861.337868:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1788526861.352761:0:16549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1788526861.352771:0:16549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788526859 -> 1788526860 00002000:00010000:3.0:1788526861.352774:0:16549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788526859 -> 1788526860 00002000:00010000:3.0:1788526861.352776:0:16549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1788526861.352796:0:16549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352812:0:16549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352822:0:16549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352830:0:16549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c1423c9200 already unused, calling callback (ffffffffc1554660) 00010000:00010000:3.0:1788526861.352836:0:16549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352922:0:16549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352945:0:16549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788526861.352967:0:16549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8b7ba7f/0x367645d450b3b906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788526861.353116:0:16549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b522680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32158e92-3529-4d93-b45d-044ba1cc8762+13:2350:x1875405869022208:12345-192.168.204.59@tcp:4:dd.0 Request processed in 113294us (295286us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788526861.353127:0:16549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000001:00080000:3.0:1788526861.410634:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1788526861.411952:0:15006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.411976:0:15006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.411986:0:15006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.411994:0:15006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245110400 already unused, calling callback (ffffffffc1554660) 00010000:00010000:0.0:1788526861.412001:0:15006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.412015:0:15006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.412040:0:15006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788526861.412073:0:15006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ace6008c/0x367645d450b3b914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788526861.412221:0:15006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32158e92-3529-4d93-b45d-044ba1cc8762+7:2349:x1875405869022592:12345-192.168.204.59@tcp:4:dd.0 Request processed in 119912us (120489us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788526861.412233:0:15006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:1.0:1788526861.412518:0:15008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412529:0:15008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412547:0:15008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412554:0:15008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98c245111a00 already unused, calling callback (ffffffffc1554660) 00010000:00010000:1.0:1788526861.412557:0:15008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412578:0:15008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412592:0:15008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788526861.412600:0:15008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000434e024d/0x367645d450b3b90d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788526861.412667:0:15008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:32158e92-3529-4d93-b45d-044ba1cc8762+5:2348:x1875405869022464:12345-192.168.204.59@tcp:4:dd.0 Request processed in 120728us (120999us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788526861.412676:0:15008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00010000:00010000:2.0:1788526861.972032:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526862.497194:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497278:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497325:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497362:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497427:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497447:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497472:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1788526862.497507:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022976 00000100:00100000:2.0:1788526862.497520:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022976 00000100:00100000:2.0:1788526862.497590:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869023488 00000100:00100000:2.0:1788526862.497594:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869023488 00000100:00100000:2.0:1788526862.497610:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869023104 00000100:00100000:2.0:1788526862.497612:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869023104 00000100:00100000:2.0:1788526862.497624:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869023360 00000100:00100000:2.0:1788526862.497626:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869023360 00000100:00100000:2.0:1788526862.497643:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1788526862.497654:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27b8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869022976:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526862.497754:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27b8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869022976:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 101us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526862.497764:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1788526862.497785:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526862.497791:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869023488:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526862.497817:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869023488:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526862.497823:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1788526862.497833:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526862.497839:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869023104:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526862.497860:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32158e92-3529-4d93-b45d-044ba1cc8762+5:2351:x1875405869023104:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526862.497874:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1788526862.497886:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1788526862.497906:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869023360:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1788526862.497933:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+5:2351:x1875405869023360:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526862.497940:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00080000:2.0:1788526862.497968:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788526862.497973:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788526862.498164:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022720 00000100:00100000:0.0:1788526862.498169:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022720 00000100:00100000:0.0:1788526862.498211:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1788526862.498219:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2351:x1875405869022720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526862.498270:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ea44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2447d4eb-66e0-4350-ab08-0b300bd12120+14:2351:x1875405869022720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 52us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526862.498278:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1788526862.498314:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869023232 00000100:00100000:0.0:1788526862.498317:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869023232 00000100:00100000:0.0:1788526862.498349:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405869022848 00000100:00100000:0.0:1788526862.498352:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405869022848 00000100:00100000:1.0:1788526862.498363:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1788526862.498378:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2351:x1875405869023232:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1788526862.498455:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c27477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fda93c2-6592-4289-96e9-be3093fbc1e2+6:2351:x1875405869023232:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 84us (1129us total) trans 0 rc 0/0 00000100:00080000:2.0:1788526862.500251:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788526862.501459:0:14316:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788526862.501482:0:14316:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788526862.501612:0:14318:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788526862.501634:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:0.0:1788526862.501652:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+20:2351:x1875405869022848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1788526862.501760:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32158e92-3529-4d93-b45d-044ba1cc8762+20:2351:x1875405869022848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 117us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526862.501769:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1788526862.512347:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00010000:00010000:1.0:1788526862.999474:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788526863.315859:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ecea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881593984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788526863.315976:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526863.316277:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881593984 00000100:00100000:3.0:1788526863.316288:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881593984 00000100:00100000:3.0:1788526863.316379:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788526863.316416:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881593984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788526863.316468:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788526863.316545:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c249740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875405881593984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526863.316553:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788526863.316665:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ecea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3278:1875405881593984:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788526863.316759:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788526863.559920:0:16601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788526864.020537:0:14305:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788526864.852021:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c26ece9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881594112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526864.852088:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526864.852155:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594112 00000100:00100000:2.0:1788526864.852163:0:15004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594112 00000100:00100000:2.0:1788526864.852230:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788526864.852239:0:15004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26eceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881594112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788526864.852273:0:15004:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788526864.852315:0:15004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26eceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875405881594112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788526864.852321:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788526864.853588:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788526864.853608:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881594624:0@lo:400:kworker.0 00000100:00100000:2.0:1788526864.853655:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788526864.853702:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788526864.853707:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98c26e811500, transno 8589934595 00000004:00080000:2.0:1788526864.853733:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788526864.853761:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c26ece9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3279:1875405881594112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788526864.853780:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788526864.853786:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881594496:0@lo:400:kworker.0 00000100:00100000:2.0:1788526864.853809:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526864.853847:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881594240:0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.853883:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526864.853908:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c274953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881594752:0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.853930:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788526864.853947:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788526864.853952:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98c249742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881594368:0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.853976:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788526864.854038:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594624 00000100:00100000:0.0:1788526864.854045:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594624 00000100:00100000:0.0:1788526864.854092:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594496 00000100:00100000:0.0:1788526864.854095:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594496 00000100:00100000:0.0:1788526864.854108:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594752 00000100:00100000:0.0:1788526864.854110:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594752 00000100:00100000:0.0:1788526864.854125:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788526864.854132:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881594624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526864.854175:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875405881594624:12345-0@lo:400:kworker.0 Request processed in 44us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526864.854192:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788526864.854206:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788526864.854212:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c26ece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881594496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526864.854238:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c26ece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875405881594496:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526864.854244:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788526864.854254:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788526864.854260:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881594752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788526864.854287:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875405881594752:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788526864.854293:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788526864.854493:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594368 00000100:00100000:1.0:1788526864.854499:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594368 00000100:00100000:1.0:1788526864.854530:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788526864.854536:0:15002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c245220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881594368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788526864.854573:0:15002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c245220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875405881594368:12345-0@lo:400:kworker.0 Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788526864.854579:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788526864.855241:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875405881594240 00000100:00100000:3.0:1788526864.855248:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875405881594240 00000100:00100000:3.0:1788526864.855283:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788526864.855302:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881594240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.855352:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98c274a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25a41ce-5827-423c-b0c5-e955955f4e9e+21:3280:x1875405881594240:12345-0@lo:400:kworker.0 Request processed in 51us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788526864.855358:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788526864.855436:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3280:1875405881594368:0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.855448:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25a41ce-5827-423c-b0c5-e955955f4e9e:3280:1875405881594240:0@lo:400:kworker.0 00000100:00100000:3.0:1788526864.855459:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3280:1875405881594752:0@lo:400:kworker.0 00000100:00080000:1.0:1788526864.861962:0:14312:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788526864.862507:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c249743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875405881594496:0@lo:400:kworker.0 00000100:00100000:1.0:1788526864.862525:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98c274b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3279:1875405881594624:0@lo:400:kworker.0 00010000:00010000:1.0:1788526865.046404:0:14304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 31309 lines, 31309 kept, 0 dropped, 0 bad.